-- Logs begin at Mon 2022-09-26 04:47:43 UTC, end at Mon 2022-09-26 05:46:37 UTC. -- Sep 26 05:14:32.751206 dv-cinder-859186-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 26 05:14:32.758938 dv-cinder-859186-2-smb devstack@keystone.service[81579]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 05:14:32 2022] *** Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: nodename: dv-cinder-859186-2-smb Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: machine: x86_64 Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: clock source: unix Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: pcre jit disabled Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: detected number of CPU cores: 4 Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: current working directory: / Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: detected binary path: /usr/bin/uwsgi-core Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: your processes number limit is 47680 Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: your memory page size is 4096 bytes Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: detected max file descriptor number: 2048 Sep 26 05:14:32.761018 dv-cinder-859186-2-smb devstack@keystone.service[81579]: lock engine: pthread robust mutexes Sep 26 05:14:32.761877 dv-cinder-859186-2-smb devstack@keystone.service[81579]: thunder lock: enabled Sep 26 05:14:32.761877 dv-cinder-859186-2-smb devstack@keystone.service[81579]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 26 05:14:32.761877 dv-cinder-859186-2-smb devstack@keystone.service[81579]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 05:14:32.800985 dv-cinder-859186-2-smb devstack@keystone.service[81579]: Python main interpreter initialized at 0x556f895be9c0 Sep 26 05:14:32.800985 dv-cinder-859186-2-smb devstack@keystone.service[81579]: python threads support enabled Sep 26 05:14:32.800985 dv-cinder-859186-2-smb devstack@keystone.service[81579]: your server socket listen backlog is limited to 100 connections Sep 26 05:14:32.800985 dv-cinder-859186-2-smb devstack@keystone.service[81579]: your mercy for graceful operations on workers is 90 seconds Sep 26 05:14:32.801391 dv-cinder-859186-2-smb devstack@keystone.service[81579]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 05:14:32.801475 dv-cinder-859186-2-smb devstack@keystone.service[81579]: *** Operational MODE: preforking *** Sep 26 05:14:32.801730 dv-cinder-859186-2-smb devstack@keystone.service[81579]: *** uWSGI is running in multiple interpreter mode *** Sep 26 05:14:32.801730 dv-cinder-859186-2-smb devstack@keystone.service[81579]: spawned uWSGI master process (pid: 81579) Sep 26 05:14:32.801937 dv-cinder-859186-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 26 05:14:32.803212 dv-cinder-859186-2-smb devstack@keystone.service[81579]: spawned uWSGI worker 1 (pid: 81592, cores: 1) Sep 26 05:14:32.803212 dv-cinder-859186-2-smb devstack@keystone.service[81579]: spawned uWSGI worker 2 (pid: 81593, cores: 1) Sep 26 05:14:32.803212 dv-cinder-859186-2-smb devstack@keystone.service[81579]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 05:14:37.035450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:14:37.035450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: from cryptography.utils import int_from_bytes Sep 26 05:14:37.036337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:14:37.036337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: from cryptography.utils import int_from_bytes Sep 26 05:14:37.036457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:14:37.036457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: from cryptography.utils import int_from_bytes Sep 26 05:14:37.036457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:14:37.036457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: from cryptography.utils import int_from_bytes Sep 26 05:14:37.085705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:14:37.085889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:14:37.085993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:14:37.086071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:14:37.086137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] command line args: [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:14:37.086200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] command line args: [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:14:37.086329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:14:37.086471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:14:37.086546 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ================================================================================ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:14:37.086613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ================================================================================ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:14:37.086797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] admin_token = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.086922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] admin_token = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config_dir = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config_dir = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] config_source = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] config_source = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] debug = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] debug = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.087997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.088930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_config_append = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_config_append = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_dir = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_dir = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.089913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.090997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.091077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.091138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.091366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.091487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.091623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.091704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.091897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.092849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.093040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.093221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.093318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.093521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.093702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] publish_errors = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.093784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.093931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] publish_errors = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.094985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] standard_threads = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] standard_threads = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_journal = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.095869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_json = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_journal = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_stderr = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_json = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] use_syslog = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_stderr = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] use_syslog = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:14:37.096769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.096943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.097996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.098926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099809 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.099891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.100996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.101933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.102976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.103928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.104856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.105935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.106998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.107967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.108909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.109988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.110977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.111896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112339 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.112982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.113926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.114932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.115889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.116963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.117923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.118925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.119995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.120931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.external = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.121985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.external = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.password = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.122977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] auth.token = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.password = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] auth.token = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.123916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.124995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125806 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.125953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.126969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.127132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.127219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.127360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.127438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.127633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.127717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.127914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.128969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.129902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.130993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.131968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.132984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.133912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.134878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.135942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.136985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.137964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.138960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.139937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.140095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.140175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.140327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.140406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.140596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.140829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.140907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141384 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.141840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.142995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.143947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.144909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.145872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.146947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.147927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.148931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.149864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.150958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.151960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152694 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.152933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.153881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.154995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.155922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.156880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.157838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.158961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.159098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.159193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.159336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.159436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.159601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.159849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.159929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.160913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.161989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.162935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.163962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.164903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165056 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.165862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.166954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.167945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.168976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.169944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.170920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.171878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.172037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.172118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.172268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.172347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.172419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:14:37.172491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.172719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.172953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:14:37.173124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:14:37.201740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.201942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.202192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.202884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.203120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.203350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.210452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.211709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.238373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.238623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.239872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.240113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.291250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.291806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.339771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.339972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.340453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.340693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.498499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.498712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.498924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.499049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.499160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.499240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.499304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.499569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.499705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.499806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.500009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.500232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.522139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.522391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.522559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.522559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.522721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.522797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.522860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.523006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.523146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.523219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.523297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.523378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.523451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.523682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.534695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.534933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.547459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.547614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.547700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.547920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81592) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.548889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81593) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:14:37.565744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.565880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.565963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:14:37.566039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:14:37.566269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.566417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.566503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:14:37.566586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:14:37.566736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.566828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.566943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.567032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.567236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.567362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.567445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.567523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.577041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.577251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.577352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.577518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.577649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.577783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.577878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.578096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.584731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.585123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.587671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.587960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.588084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.588246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.588377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.588530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.588676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.588758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.588905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.589074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.589214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.589354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.589453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.589543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.589758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.589887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.590035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.590125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.590281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.590372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.590562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.590835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.613114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.613820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.614566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.614854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.615289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.615582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.619503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.619810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.620095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.620333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.620617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.620905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.626754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.627038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.627285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.627581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.632627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.632920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.633206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.633331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.633496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.633645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.633754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.633845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.634033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.634159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.634299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.634392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.634584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.634712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.634875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.635146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.650346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.650623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.650749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.650907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.654494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.654768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.657731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.657981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.658108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.658261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.662177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.662438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.665376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.665503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.668580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.668777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.668871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.668997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.669122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.669242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.669372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.669568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.669750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.669980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.670104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.670237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.685851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.686083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.686185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.686409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.686542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.686641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.686709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.686924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.693905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.694033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.695462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.695674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.697033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.697162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.697315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.697449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.700116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.700242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.700378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.700458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.700670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.700816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.700953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.701067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.701431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.701560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.712620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.712749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.712887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.712967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.713166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.713315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.713401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.713477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.713807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.713934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.714085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.714175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.714312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.714391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.729755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.729902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.732771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.732900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.735768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.735895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.737250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.737378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.738703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.738832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.738953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.739037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.739372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.739499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.745717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.745845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.747155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.747303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.750086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.750214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.750477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.750605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.750743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.750843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.751003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.751093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.758787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.758917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.759065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.759277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.759412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.759637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.766377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81592) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.766583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81593) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:14:37.766676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.766810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.766938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.767064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.767144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.767362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.767587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.767742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.767823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.767930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.768035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.768209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.768310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.768528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.768669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.768754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.768829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.769061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.769188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.769312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.769419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.769611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.769738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.769893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.770021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81592) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.770143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81593) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:14:37.803632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556f895be9c0 pid: 81592 (default app) Sep 26 05:14:37.804527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556f895be9c0 pid: 81593 (default app) Sep 26 05:14:37.807045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10ded-1bcb-47ba-86ba-558b743db9b0 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:37.807333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10ded-1bcb-47ba-86ba-558b743db9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:37.807606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10ded-1bcb-47ba-86ba-558b743db9b0 None None] PATH_INFO: `/v3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:37.811863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Mon Sep 26 05:14:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:44.703529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea88-4ebf-45a3-a3d4-fc0386c51d50 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:44.704112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea88-4ebf-45a3-a3d4-fc0386c51d50 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:44.704112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea88-4ebf-45a3-a3d4-fc0386c51d50 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:44.708433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:14:44.715062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:44.715912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:44.716152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:44.786770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: INFO dbcounter [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] Registered counter for database keystone Sep 26 05:14:44.808034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG oslo_db.sqlalchemy.engines [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:14:44.817197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writer thread running {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:14:45.003606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG passlib.handlers.bcrypt [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81592) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 05:14:45.003920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG passlib.handlers.bcrypt [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81592) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 05:14:45.062598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:45.064550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:45.198956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 05:14:45.696962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310ea88-4ebf-45a3-a3d4-fc0386c51d50 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:45.774935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: INFO dbcounter [None req-2310ea88-4ebf-45a3-a3d4-fc0386c51d50 None None] Registered counter for database keystone Sep 26 05:14:45.798783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG oslo_db.sqlalchemy.engines [None req-2310ea88-4ebf-45a3-a3d4-fc0386c51d50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:14:45.805898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writer thread running {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:14:45.923221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310ea88-4ebf-45a3-a3d4-fc0386c51d50 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:45.928755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c033bb-c5c4-4753-9dba-b1773cc62e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:45.929389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c033bb-c5c4-4753-9dba-b1773cc62e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:45.929666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c033bb-c5c4-4753-9dba-b1773cc62e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:45.929929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c033bb-c5c4-4753-9dba-b1773cc62e4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:45.939502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c033bb-c5c4-4753-9dba-b1773cc62e4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:45.990869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING keystone.common.rbac_enforcer.enforcer [None req-97c033bb-c5c4-4753-9dba-b1773cc62e4e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 05:14:45.991145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c033bb-c5c4-4753-9dba-b1773cc62e4e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:46.001862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Sep 26 05:14:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:14:46.008417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:46.027657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa385a2b-5926-4dce-8d71-1f0840d2377c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:46.033274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555edb88-a342-4e16-8e43-b357b09b5d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:46.034398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edb88-a342-4e16-8e43-b357b09b5d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:46.034675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edb88-a342-4e16-8e43-b357b09b5d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:46.034944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555edb88-a342-4e16-8e43-b357b09b5d03 admin admin] PATH_INFO: `/v3/projects/2e12d4768420490681bee18f38969146` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:46.036678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555edb88-a342-4e16-8e43-b357b09b5d03 admin admin] RBAC: Authorizing `identity:get_project(project_id=2e12d4768420490681bee18f38969146)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:46.089279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING keystone.common.rbac_enforcer.enforcer [None req-555edb88-a342-4e16-8e43-b357b09b5d03 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 05:14:46.089617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555edb88-a342-4e16-8e43-b357b09b5d03 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:46.094236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Mon Sep 26 05:14:46 2022] GET /identity/v3/projects/2e12d4768420490681bee18f38969146 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:14:48.225302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa3d6-0c45-4a58-95ef-8320a10e70e2 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:48.226193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa3d6-0c45-4a58-95ef-8320a10e70e2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:48.226193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa3d6-0c45-4a58-95ef-8320a10e70e2 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:48.232996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:48 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:48.239034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60c88-7e63-46ec-a320-7ca74bf5d80a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:48.239466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60c88-7e63-46ec-a320-7ca74bf5d80a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:48.239576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c60c88-7e63-46ec-a320-7ca74bf5d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:48.261921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f6c60c88-7e63-46ec-a320-7ca74bf5d80a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:48.263456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f6c60c88-7e63-46ec-a320-7ca74bf5d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:48.272064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 05:14:48.534421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baa3d6-0c45-4a58-95ef-8320a10e70e2 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:48.557640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baa3d6-0c45-4a58-95ef-8320a10e70e2 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:48.565358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015b09f-526c-4751-914d-a87a44b86386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:48.565968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b09f-526c-4751-914d-a87a44b86386 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:48.566246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b09f-526c-4751-914d-a87a44b86386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:48.566515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b09f-526c-4751-914d-a87a44b86386 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:48.575085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015b09f-526c-4751-914d-a87a44b86386 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:48.576904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015b09f-526c-4751-914d-a87a44b86386 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:48.586582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Mon Sep 26 05:14:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:14:48.592183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60c88-7e63-46ec-a320-7ca74bf5d80a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:48.601592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c60c88-7e63-46ec-a320-7ca74bf5d80a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:48.606435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5580b88-e8bb-4b51-9659-2c21f9dc5d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:48.607064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580b88-e8bb-4b51-9659-2c21f9dc5d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:48.607343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580b88-e8bb-4b51-9659-2c21f9dc5d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:48.607654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5580b88-e8bb-4b51-9659-2c21f9dc5d67 admin admin] PATH_INFO: `/v3/users/7c1388531c2849fcb94bee4071a75c53` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:48.609001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5580b88-e8bb-4b51-9659-2c21f9dc5d67 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c1388531c2849fcb94bee4071a75c53)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:48.610852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5580b88-e8bb-4b51-9659-2c21f9dc5d67 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:48.612422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Mon Sep 26 05:14:48 2022] GET /identity/v3/users/7c1388531c2849fcb94bee4071a75c53 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:14:50.819132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ca1d3-e7e7-4b7e-b652-84aa0d5f3e22 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:50.819740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ca1d3-e7e7-4b7e-b652-84aa0d5f3e22 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:50.819740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ca1d3-e7e7-4b7e-b652-84aa0d5f3e22 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:50.821137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:50.826427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9438ed-e05e-4709-b114-4775f286fc00 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:50.826885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9438ed-e05e-4709-b114-4775f286fc00 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:50.826978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9438ed-e05e-4709-b114-4775f286fc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:50.844374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d8f24-3894-4fa2-997b-e7c3a021cacb None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:50.844652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d8f24-3894-4fa2-997b-e7c3a021cacb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:50.844924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d8f24-3894-4fa2-997b-e7c3a021cacb None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:50.846237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:50.846686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7b9438ed-e05e-4709-b114-4775f286fc00 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:50.847967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7b9438ed-e05e-4709-b114-4775f286fc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:50.851211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:50.851735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:50.852080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:50.895036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG passlib.handlers.bcrypt [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81593) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 05:14:50.895426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG passlib.handlers.bcrypt [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81593) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 05:14:50.935902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:14:50.944443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:50.946058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:51.050305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:14:51.211686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9438ed-e05e-4709-b114-4775f286fc00 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.238148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:51.309970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.326154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9438ed-e05e-4709-b114-4775f286fc00 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.361368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.362020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.362307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.362583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.375053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:14:51.384635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:14:51.385604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:14:51.386621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:14:51.391812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.419412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b36939-a408-43e3-a211-ddae0c1acd62 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.421935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:51.459690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.460710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.460987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.461255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.473724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:51.492176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebca73-7e23-4722-9b60-681c447e470d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.524923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.525531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.525811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.526078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.526747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:14:51.527055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:51.527889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:51.528479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:51.529406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:51.540123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:51.545805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.627658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:14:51.633205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.635922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:51.644968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a092-6e6b-4949-a2d8-30624c06305c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.678329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.678982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.679254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.679527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] PATH_INFO: `/v3/users/7c1388531c2849fcb94bee4071a75c53` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.680717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] RBAC: Authorizing `identity:get_user(user_id=7c1388531c2849fcb94bee4071a75c53)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:51.682181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:51.683779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/users/7c1388531c2849fcb94bee4071a75c53 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:14:51.689745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.703923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:51.729473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f3fe-54e1-4a61-a15a-f85b7be07741 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.762513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.763370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.763676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.763944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.782273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:51.783782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:51.796930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef24377-c03e-45d6-afa4-d17ab7340d3f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:14:51.801866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:14:51.802929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:14:51.803814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:14:51.803814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:14:51.803814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:14:51.803814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:14:51.808951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.834193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.834820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.835095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.835364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.836506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:51.837953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:51.839506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:14:51.846352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:51.865959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:51.914135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec7cad-00cd-44e1-8610-455748fb7388 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.927738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:51.947667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096778b1-df62-4a2d-b6c6-04de852fd9b3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:51.948129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03601df-3cba-4f15-ac75-6bcd017973c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.948741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03601df-3cba-4f15-ac75-6bcd017973c4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.949024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03601df-3cba-4f15-ac75-6bcd017973c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.949310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03601df-3cba-4f15-ac75-6bcd017973c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.949953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03601df-3cba-4f15-ac75-6bcd017973c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:14:51.950256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03601df-3cba-4f15-ac75-6bcd017973c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:51.951692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03601df-3cba-4f15-ac75-6bcd017973c4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:51.969243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:14:51.982922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547a1c8-62eb-4ecc-8ce7-d8d7f5c75b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:51.983468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a1c8-62eb-4ecc-8ce7-d8d7f5c75b8c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:51.983873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a1c8-62eb-4ecc-8ce7-d8d7f5c75b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:51.984151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547a1c8-62eb-4ecc-8ce7-d8d7f5c75b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:51.985055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a1c8-62eb-4ecc-8ce7-d8d7f5c75b8c None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.domain.id=default, user.id=7c1388531c2849fcb94bee4071a75c53) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:14:51.985359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a1c8-62eb-4ecc-8ce7-d8d7f5c75b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:51.986848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547a1c8-62eb-4ecc-8ce7-d8d7f5c75b8c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:51.994609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Sep 26 05:14:51 2022] GET /identity/v3/role_assignments?user.id=7c1388531c2849fcb94bee4071a75c53&scope.domain.id=default&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:14:54.521574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9ec8-f0d4-4dc2-bfdf-07a2ed70cfb8 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:54.522116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9ec8-f0d4-4dc2-bfdf-07a2ed70cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:54.522116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c9ec8-f0d4-4dc2-bfdf-07a2ed70cfb8 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:54.523611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:54.531053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c88b7-7860-4f15-ac7c-f96fb1973b0a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:54.531941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c88b7-7860-4f15-ac7c-f96fb1973b0a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:54.532447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c88b7-7860-4f15-ac7c-f96fb1973b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:54.561150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-943c88b7-7860-4f15-ac7c-f96fb1973b0a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:54.561653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58915807-d5b2-49c6-ac3d-085f338472db None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:54.562167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58915807-d5b2-49c6-ac3d-085f338472db None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:54.562708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58915807-d5b2-49c6-ac3d-085f338472db None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:54.563053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-943c88b7-7860-4f15-ac7c-f96fb1973b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:54.564792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 12/23] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:54.570474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdad6d-71b7-4312-a545-78c515f7f4d6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:54.570986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdad6d-71b7-4312-a545-78c515f7f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:54.571446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdad6d-71b7-4312-a545-78c515f7f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:54.605116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d9bdad6d-71b7-4312-a545-78c515f7f4d6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:54.605903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d9bdad6d-71b7-4312-a545-78c515f7f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:54.681265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:14:54.683270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3824771-9e0a-4392-b863-7b7dce6b41b6 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:54.683571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3824771-9e0a-4392-b863-7b7dce6b41b6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:54.684987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3824771-9e0a-4392-b863-7b7dce6b41b6 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:54.687776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 13/25] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:54.693153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553d28-6a76-4f3c-b615-ac16bf5b58cc None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:54.693441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553d28-6a76-4f3c-b615-ac16bf5b58cc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:54.693713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49553d28-6a76-4f3c-b615-ac16bf5b58cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:54.727350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-49553d28-6a76-4f3c-b615-ac16bf5b58cc None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:54.728586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-49553d28-6a76-4f3c-b615-ac16bf5b58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:54.755044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 13/26] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:14:54.836976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 14/27] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:14:55.003866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdad6d-71b7-4312-a545-78c515f7f4d6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.060640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:55.132174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bdad6d-71b7-4312-a545-78c515f7f4d6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:55.189544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:55.190207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.190490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.190757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.210173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:14:55.216706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:14:55.217623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:14:55.218486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 14/28] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:14:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:14:55.225757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553d28-6a76-4f3c-b615-ac16bf5b58cc None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.230465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:55.359963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.373673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49553d28-6a76-4f3c-b615-ac16bf5b58cc None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:55.423171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563862c4-53ae-4510-87a5-a0d14d38c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:55.424081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563862c4-53ae-4510-87a5-a0d14d38c40a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.424364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563862c4-53ae-4510-87a5-a0d14d38c40a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.424640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563862c4-53ae-4510-87a5-a0d14d38c40a None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.425583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563862c4-53ae-4510-87a5-a0d14d38c40a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:14:55.425892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563862c4-53ae-4510-87a5-a0d14d38c40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:55.427788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563862c4-53ae-4510-87a5-a0d14d38c40a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:55.439328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 15/29] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:14:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:55.440781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb735-0c6a-4ef2-826e-eb5a93c30024 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.441072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb735-0c6a-4ef2-826e-eb5a93c30024 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.441606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbb735-0c6a-4ef2-826e-eb5a93c30024 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.442822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:55.443518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbb735-0c6a-4ef2-826e-eb5a93c30024 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.485571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7627fd2-6a62-4246-ac36-91ad0ea347fe None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:55.493279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:55.522007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fa9db-6f99-44ce-96c4-b16d0a170999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:55.523357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fa9db-6f99-44ce-96c4-b16d0a170999 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.523835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fa9db-6f99-44ce-96c4-b16d0a170999 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.524276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fa9db-6f99-44ce-96c4-b16d0a170999 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.525101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fa9db-6f99-44ce-96c4-b16d0a170999 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:55.526632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fa9db-6f99-44ce-96c4-b16d0a170999 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:55.527604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:55.568137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbb735-0c6a-4ef2-826e-eb5a93c30024 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:55.604618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:55.605264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.605596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.605870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.617510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:55.619102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:14:55.635623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:14:55.636693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:14:55.637573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:14:55.637573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:14:55.637573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:14:55.637573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 17/31] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:14:55.637573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.669575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 15/32] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 05:14:55 2022] POST /identity/v3/roles => generated 219 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:14:55.671672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59019fd-7cf2-4c4f-9f9c-9d28ac89b737 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.672210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59019fd-7cf2-4c4f-9f9c-9d28ac89b737 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.672634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59019fd-7cf2-4c4f-9f9c-9d28ac89b737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.693840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a59019fd-7cf2-4c4f-9f9c-9d28ac89b737 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:55.695833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a59019fd-7cf2-4c4f-9f9c-9d28ac89b737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:55.750662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8460c-96bc-4dc2-89c3-a4f9a64558f1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:55.769659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:55.775445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 16/33] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:14:55.777532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59019fd-7cf2-4c4f-9f9c-9d28ac89b737 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.789011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:55.789704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.790050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.790324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] PATH_INFO: `/v3/users/7c1388531c2849fcb94bee4071a75c53` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.791571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1388531c2849fcb94bee4071a75c53)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:55.793167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:55.794997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 18/34] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:14:55 2022] GET /identity/v3/users/7c1388531c2849fcb94bee4071a75c53 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:55.804852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.887722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:55.896215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59019fd-7cf2-4c4f-9f9c-9d28ac89b737 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:55.916305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389c2d-9570-4ee9-9850-b78d2734cc91 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:55.936463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:55.937445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.937861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.938699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.939487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:14:55.939964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:55.941721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:55.953716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:55.954363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:55.954649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:55.954923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:55.955459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 17/35] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:55.956135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:55.957652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:55.959422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 19/36] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:14:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:55.965039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:55.969998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:56.059086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:56.076872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239e05-9aba-4058-b8d7-9d209abc4771 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:56.125804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:56.126900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:56.127469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:56.128036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] PATH_INFO: `/v3/domains/default/users/7c1388531c2849fcb94bee4071a75c53/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:56.131134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f491-1235-4c92-8f0b-eea7a61621f4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:56.137024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7c1388531c2849fcb94bee4071a75c53, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:56.138828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:56.170847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd02edd-6b12-4ab3-be0f-39e9087ea5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:56.171527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02edd-6b12-4ab3-be0f-39e9087ea5c6 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:56.171837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02edd-6b12-4ab3-be0f-39e9087ea5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:56.172113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd02edd-6b12-4ab3-be0f-39e9087ea5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:56.172802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd02edd-6b12-4ab3-be0f-39e9087ea5c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:56.174243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd02edd-6b12-4ab3-be0f-39e9087ea5c6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:56.181477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 18/37] 10.222.0.18 () {58 vars in 1361 bytes} [Mon Sep 26 05:14:55 2022] PUT /identity/v3/domains/default/users/7c1388531c2849fcb94bee4071a75c53/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:14:56.183912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:56.211101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:56.330693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfef76-4d26-4ee9-a064-85a566b6366b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:56.372151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31442c-37f3-4379-acce-a6de7dd1464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:56.372909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31442c-37f3-4379-acce-a6de7dd1464f None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:56.373305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31442c-37f3-4379-acce-a6de7dd1464f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:56.373660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31442c-37f3-4379-acce-a6de7dd1464f None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:56.374500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31442c-37f3-4379-acce-a6de7dd1464f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:56.376105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31442c-37f3-4379-acce-a6de7dd1464f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:56.391047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 20/38] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:14:55 2022] POST /identity/v3/projects => generated 301 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:14:56.392579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1acc71-2c86-438d-9335-82a90b57c448 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:56.392881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1acc71-2c86-438d-9335-82a90b57c448 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:56.393159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1acc71-2c86-438d-9335-82a90b57c448 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:56.394482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 21/39] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:56.401535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864db4-7ea3-43bf-a7f4-fa12694ff879 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:56.401918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864db4-7ea3-43bf-a7f4-fa12694ff879 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:56.402269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22864db4-7ea3-43bf-a7f4-fa12694ff879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:56.403792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 19/40] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 05:14:56 2022] POST /identity/v3/roles => generated 225 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:14:56.441822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-22864db4-7ea3-43bf-a7f4-fa12694ff879 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:56.443983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-22864db4-7ea3-43bf-a7f4-fa12694ff879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:56.465586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293370-c76b-4dcd-9bd6-df54ec51aa2d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:56.465586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293370-c76b-4dcd-9bd6-df54ec51aa2d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:56.465862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80293370-c76b-4dcd-9bd6-df54ec51aa2d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:56.467275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 20/41] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:56.477106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb055079-57d0-4b85-b051-85226b7df37d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:56.477401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb055079-57d0-4b85-b051-85226b7df37d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:56.477674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb055079-57d0-4b85-b051-85226b7df37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:56.500683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fb055079-57d0-4b85-b051-85226b7df37d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:56.501961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fb055079-57d0-4b85-b051-85226b7df37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:56.541951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:14:56.586276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:14:56.829426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22864db4-7ea3-43bf-a7f4-fa12694ff879 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:56.866251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:56.889813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb055079-57d0-4b85-b051-85226b7df37d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:56.898894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:57.010436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb055079-57d0-4b85-b051-85226b7df37d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:57.047783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:57.048436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:57.048719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:57.048994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:57.049084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22864db4-7ea3-43bf-a7f4-fa12694ff879 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:57.050114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:57.051964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:57.053343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 22/44] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:14:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:57.058735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:57.091065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073056e1-2011-42a6-8858-c913fb7665fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:57.091778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073056e1-2011-42a6-8858-c913fb7665fa None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:57.092058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073056e1-2011-42a6-8858-c913fb7665fa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:57.092380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073056e1-2011-42a6-8858-c913fb7665fa None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:57.093128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073056e1-2011-42a6-8858-c913fb7665fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:57.094633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073056e1-2011-42a6-8858-c913fb7665fa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:57.112822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 05:14:56 2022] POST /identity/v3/roles => generated 223 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:14:57.144100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:57.177860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e446c-b705-47e9-bac7-e64c4ab31791 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:57.219524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7d815-af36-48a8-aba9-14f06e9c8247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:57.220199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7d815-af36-48a8-aba9-14f06e9c8247 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:57.220471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7d815-af36-48a8-aba9-14f06e9c8247 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:57.220749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7d815-af36-48a8-aba9-14f06e9c8247 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:57.221429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7d815-af36-48a8-aba9-14f06e9c8247 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:57.222940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7d815-af36-48a8-aba9-14f06e9c8247 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:57.258651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:14:57 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:14:58.501537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35c6d7-bd81-4d10-a959-02e64071a448 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:58.502110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35c6d7-bd81-4d10-a959-02e64071a448 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:58.502110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35c6d7-bd81-4d10-a959-02e64071a448 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:58.503413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:14:58.508938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844fe47-3fea-464d-ba56-f4f16b11edab None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:58.509376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844fe47-3fea-464d-ba56-f4f16b11edab None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:58.509619 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844fe47-3fea-464d-ba56-f4f16b11edab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:58.528999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7844fe47-3fea-464d-ba56-f4f16b11edab None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:58.530209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7844fe47-3fea-464d-ba56-f4f16b11edab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:58.600842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:14:58.864035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35c6d7-bd81-4d10-a959-02e64071a448 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:58.967291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:58.976089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35c6d7-bd81-4d10-a959-02e64071a448 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:59.012229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:59.012866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:59.013150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:59.013410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:59.024462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:14:59.029432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:14:59.030268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:14:59.031349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:14:59.036852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844fe47-3fea-464d-ba56-f4f16b11edab None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:59.093520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:59.139738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844fe47-3fea-464d-ba56-f4f16b11edab None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:59.175202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:59.175855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:59.176138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:59.176410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:59.177068 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:14:59.177373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:59.178764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:59.190944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:59.197365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:59.308830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbc151-3066-4807-81f9-707de92ddf3d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:59.344983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222684e-2929-4368-8816-954628ce3d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:59.345623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222684e-2929-4368-8816-954628ce3d4a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:59.345908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222684e-2929-4368-8816-954628ce3d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:59.346188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222684e-2929-4368-8816-954628ce3d4a None admin] PATH_INFO: `/v3/users/7c1388531c2849fcb94bee4071a75c53` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:59.347342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222684e-2929-4368-8816-954628ce3d4a None admin] RBAC: Authorizing `identity:get_user(user_id=7c1388531c2849fcb94bee4071a75c53)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:59.348865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222684e-2929-4368-8816-954628ce3d4a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:59.350436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:14:59 2022] GET /identity/v3/users/7c1388531c2849fcb94bee4071a75c53 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:59.356161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:59.400909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac85c8-5f49-4f90-b2bf-d8f1f0d3bde4 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:59.401088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac85c8-5f49-4f90-b2bf-d8f1f0d3bde4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:59.401368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac85c8-5f49-4f90-b2bf-d8f1f0d3bde4 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:59.402701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 27/52] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:14:59.407823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6257f6f-9776-4053-b1ff-f7e10d051581 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:59.408103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6257f6f-9776-4053-b1ff-f7e10d051581 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:59.408367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6257f6f-9776-4053-b1ff-f7e10d051581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:59.427012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a6257f6f-9776-4053-b1ff-f7e10d051581 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:14:59.428234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a6257f6f-9776-4053-b1ff-f7e10d051581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:14:59.446103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:59.461945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6ab37-8a9c-4a3e-b704-779aa5214c73 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:59.479971 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:14:59.497615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:59.498265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:59.498467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 28/53] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:14:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:14:59.498585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:59.498817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:59.500430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:59.501899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:59.503492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 26/54] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:59.509353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6257f6f-9776-4053-b1ff-f7e10d051581 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:59.612892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6257f6f-9776-4053-b1ff-f7e10d051581 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:14:59.647405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:14:59.648047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:14:59.648333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:14:59.648604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:14:59.649337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.domain.id=default, user.id=7c1388531c2849fcb94bee4071a75c53) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:14:59.649653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:14:59.651199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:14:59.657598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 29/55] 10.222.0.18 () {56 vars in 1322 bytes} [Mon Sep 26 05:14:59 2022] GET /identity/v3/role_assignments?user.id=7c1388531c2849fcb94bee4071a75c53&scope.domain.id=default&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:14:59.760890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:14:59.868258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee356a3-63da-4c0d-ac9f-80c18320f7e0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:00.017387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023fe897-0b38-43fd-b109-d4a457843bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:00.017904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fe897-0b38-43fd-b109-d4a457843bda None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:00.018188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fe897-0b38-43fd-b109-d4a457843bda None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:00.018457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023fe897-0b38-43fd-b109-d4a457843bda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:00.019689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fe897-0b38-43fd-b109-d4a457843bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:00.021120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023fe897-0b38-43fd-b109-d4a457843bda None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:00.022685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 27/56] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:00.028767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:00.048768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:00.143273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b542eb-83f5-4481-a2cc-d5803f9ccdaa None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:00.183061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e121c-b797-439b-8647-d5ee47bd7c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:00.183694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e121c-b797-439b-8647-d5ee47bd7c81 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:00.183972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e121c-b797-439b-8647-d5ee47bd7c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:00.184240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e121c-b797-439b-8647-d5ee47bd7c81 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:00.184899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e121c-b797-439b-8647-d5ee47bd7c81 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:00.186344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e121c-b797-439b-8647-d5ee47bd7c81 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:00.221481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 30/57] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Sep 26 05:15:00 2022] POST /identity/v3/projects => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:02.342676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1ace-fe1c-4414-82c6-559a8fb5f848 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:02.343348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1ace-fe1c-4414-82c6-559a8fb5f848 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:02.343768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf1ace-fe1c-4414-82c6-559a8fb5f848 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:02.345966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 28/58] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:02.352410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12188-d54c-489f-849d-abf576152d21 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:02.353081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12188-d54c-489f-849d-abf576152d21 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:02.353340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f12188-d54c-489f-849d-abf576152d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:02.376246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e6f12188-d54c-489f-849d-abf576152d21 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:02.377460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e6f12188-d54c-489f-849d-abf576152d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:02.443243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:02.451333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 31/59] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:02.719920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1ace-fe1c-4414-82c6-559a8fb5f848 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:02.781919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:02.831764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf1ace-fe1c-4414-82c6-559a8fb5f848 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:02.868711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd38f6d-c7b1-4fff-8f2b-cd9f8a7f7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:02.869343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd38f6d-c7b1-4fff-8f2b-cd9f8a7f7eda None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:02.869623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd38f6d-c7b1-4fff-8f2b-cd9f8a7f7eda None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:02.869894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd38f6d-c7b1-4fff-8f2b-cd9f8a7f7eda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:02.871064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd38f6d-c7b1-4fff-8f2b-cd9f8a7f7eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:02.872660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd38f6d-c7b1-4fff-8f2b-cd9f8a7f7eda None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:02.874658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 29/60] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:02.884494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f12188-d54c-489f-849d-abf576152d21 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:03.022663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f12188-d54c-489f-849d-abf576152d21 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:03.075411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5ed4-e740-4b93-b9c4-5ea3dc26c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:03.076095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5ed4-e740-4b93-b9c4-5ea3dc26c903 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:03.076380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5ed4-e740-4b93-b9c4-5ea3dc26c903 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:03.076659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5ed4-e740-4b93-b9c4-5ea3dc26c903 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:03.077921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5ed4-e740-4b93-b9c4-5ea3dc26c903 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:03.079404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5ed4-e740-4b93-b9c4-5ea3dc26c903 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:03.110710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 32/61] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:15:02 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:06.307928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034651-4f62-483f-a37e-ad2ada1eedc1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:06.308883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034651-4f62-483f-a37e-ad2ada1eedc1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:06.309380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf034651-4f62-483f-a37e-ad2ada1eedc1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:06.310990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 30/62] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:06.326886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2e61-7863-4f2b-b02f-5e970c2d8a80 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:06.327968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2e61-7863-4f2b-b02f-5e970c2d8a80 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:06.327968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff2e61-7863-4f2b-b02f-5e970c2d8a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:06.365541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0fff2e61-7863-4f2b-b02f-5e970c2d8a80 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:06.366749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0fff2e61-7863-4f2b-b02f-5e970c2d8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:06.435940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:06.461044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 33/63] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:06.610529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5a4e6-ef1d-4e09-a58d-52d2e6b01153 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:06.611185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5a4e6-ef1d-4e09-a58d-52d2e6b01153 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:06.611747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5a4e6-ef1d-4e09-a58d-52d2e6b01153 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:06.613296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 31/64] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:06.618932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac6279-841e-401d-8dcb-3d8f08c4d2c0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:06.619469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac6279-841e-401d-8dcb-3d8f08c4d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:06.619976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac6279-841e-401d-8dcb-3d8f08c4d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:06.639894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d5ac6279-841e-401d-8dcb-3d8f08c4d2c0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:06.642218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d5ac6279-841e-401d-8dcb-3d8f08c4d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:06.735724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 34/65] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:06.823778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5a4e6-ef1d-4e09-a58d-52d2e6b01153 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:06.868216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b433-968c-4308-b9ba-af34de334dab None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:06.868834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b433-968c-4308-b9ba-af34de334dab None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:06.869322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702b433-968c-4308-b9ba-af34de334dab None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:06.870942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 35/66] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:06.876924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672ecb5-43be-48ec-86a7-687453cc91fa None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:06.877515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672ecb5-43be-48ec-86a7-687453cc91fa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:06.878048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672ecb5-43be-48ec-86a7-687453cc91fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:06.907517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e672ecb5-43be-48ec-86a7-687453cc91fa None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:06.909909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e672ecb5-43be-48ec-86a7-687453cc91fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:06.995364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5a4e6-ef1d-4e09-a58d-52d2e6b01153 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.022426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 36/67] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:07.024122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f9cf-abc1-4335-8401-240ff7183fe3 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.024624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f9cf-abc1-4335-8401-240ff7183fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.025092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780f9cf-abc1-4335-8401-240ff7183fe3 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.026564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 37/68] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:07.032594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.042636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3d3a3-bd96-4a0b-8696-9cf54b0a99cf None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.043315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3d3a3-bd96-4a0b-8696-9cf54b0a99cf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.043816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3d3a3-bd96-4a0b-8696-9cf54b0a99cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.049510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.050165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.050450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.050717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.061473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:07.066640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:07.067487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:07.068315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 32/69] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:07.069412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.071255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4bf3d3a3-bd96-4a0b-8696-9cf54b0a99cf None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:07.073908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4bf3d3a3-bd96-4a0b-8696-9cf54b0a99cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:07.137415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.180666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b3487-1f3b-47a3-bcad-a698243a2791 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.190018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 38/70] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:07.191652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3d3a3-bd96-4a0b-8696-9cf54b0a99cf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.218596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.218993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.219279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.219574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.231410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:07.239426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:07.240316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:07.241080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 33/71] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:07.244284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.301741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.349046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3d3a3-bd96-4a0b-8696-9cf54b0a99cf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.362960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8b917-0def-4d63-9e82-e53441122d72 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.386267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7625-0326-4dc0-8976-b47f99d6d641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.386855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7625-0326-4dc0-8976-b47f99d6d641 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.387141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7625-0326-4dc0-8976-b47f99d6d641 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.387515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7625-0326-4dc0-8976-b47f99d6d641 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.388147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7625-0326-4dc0-8976-b47f99d6d641 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:07.388455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7625-0326-4dc0-8976-b47f99d6d641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:07.390111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7625-0326-4dc0-8976-b47f99d6d641 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:07.403687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 39/72] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:07.403947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.403947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.404108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1227a-5251-4ddb-a466-a2bb4a23557e None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.404182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.404253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1227a-5251-4ddb-a466-a2bb4a23557e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.404342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.404424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1227a-5251-4ddb-a466-a2bb4a23557e None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.404500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:07.404500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:07.404632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 40/73] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:07.404632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1227a-5251-4ddb-a466-a2bb4a23557e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.407772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:07.416699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 34/74] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:07.417437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.451292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.515409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1227a-5251-4ddb-a466-a2bb4a23557e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.524582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a64cad-c938-4c51-927f-c2e779c048a3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.526810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.547983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c684e3-4bfc-4fbb-89b7-afdff9279040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.548624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c684e3-4bfc-4fbb-89b7-afdff9279040 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.548903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c684e3-4bfc-4fbb-89b7-afdff9279040 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.549179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c684e3-4bfc-4fbb-89b7-afdff9279040 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.559568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c684e3-4bfc-4fbb-89b7-afdff9279040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:07.561762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.562401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.562679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.562953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f9c684e3-4bfc-4fbb-89b7-afdff9279040 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:07.565188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:07.566005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:07.566776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 41/75] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:07.567415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb7a6-030b-4831-9b7c-56ac7f3a2671 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.567688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb7a6-030b-4831-9b7c-56ac7f3a2671 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.571657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb7a6-030b-4831-9b7c-56ac7f3a2671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.580871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:07.582337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:07.586545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 35/76] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:07.586545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.586719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e44cb7a6-030b-4831-9b7c-56ac7f3a2671 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:07.586719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e44cb7a6-030b-4831-9b7c-56ac7f3a2671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:07.656505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 42/77] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:07.657245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb7a6-030b-4831-9b7c-56ac7f3a2671 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.697280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a436a-38fe-4bff-b027-9ef68a9ed034 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.706558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.735389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.736076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.736769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.737046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] PATH_INFO: `/v3/users/7c1388531c2849fcb94bee4071a75c53` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.738230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] RBAC: Authorizing `identity:get_user(user_id=7c1388531c2849fcb94bee4071a75c53)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:07.740175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:07.741751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 36/78] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/users/7c1388531c2849fcb94bee4071a75c53 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:07.746374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.773969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.794634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb7a6-030b-4831-9b7c-56ac7f3a2671 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.831755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.832471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.832812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.833141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.843154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:07.848022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:07.849036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:07.849991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:07.850727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9682d36-af1a-46bd-aa02-da72d1e82fcc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.855591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 43/79] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:07.855591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.891913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.892541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.892822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.893095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.893757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:07.894062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:07.895449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:07.904509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 37/80] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:07.905434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:07.949369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:07.961610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c5ee5-b29d-4aa5-bd4a-2c4802f19dd7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:07.995298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:07.995906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:07.996183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:07.996483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:07.999141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.008761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7150294-f867-415a-b3c1-a4c4f69fc489 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.044378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810283-fb00-446e-a345-99e085133825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.044982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810283-fb00-446e-a345-99e085133825 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.045259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810283-fb00-446e-a345-99e085133825 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.045512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1810283-fb00-446e-a345-99e085133825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.069604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.071099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.114373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1810283-fb00-446e-a345-99e085133825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.115872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1810283-fb00-446e-a345-99e085133825 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.156158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.169000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 44/81] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:08.169817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.208091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.218120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 38/82] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:08.223520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810283-fb00-446e-a345-99e085133825 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.268223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f80a34-6ce4-4570-8366-07d735c062a5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.303805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.304422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.304701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.304968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.305628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:08.305928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.307310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.315699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 45/83] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:08.317556 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.322773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1810283-fb00-446e-a345-99e085133825 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.355898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.356535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.356816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.357090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.358229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.359787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.361400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 39/84] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:08.362160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.370154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.418960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.421699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1269-4c1d-4c5e-b5fa-52a127d80c14 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.454794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.455433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.455745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.456021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.457141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.458664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.458974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfcb6c-5e4d-4120-ac5f-d9958a56b651 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.460232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 46/85] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:08.461007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.493719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.494350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.494620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.494896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.496086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.497515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.499430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 40/86] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:08.499967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.563121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb1399-9598-4081-b1ae-dc8986eabb41 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.580879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.598415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.599047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.599328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.599637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.600780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.602242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.602988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e60a-7bc0-42c4-a96c-87e339864115 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.603907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 47/87] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:08.604667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.635063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.643518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.644196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.644475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.644747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.645876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.647309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.648910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 41/88] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:08.649649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.713096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209b7f7-ee07-43c4-8830-2ac9972c084c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.747309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.747952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.748236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.748328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27cc1-1e03-4885-982c-82aeaf9f55af None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.748513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.781262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.781866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.782146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.782415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.783064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.784520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.807397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.814146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 42/89] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:15:08 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:08.814967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.826951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.828942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.874422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:08.933689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac4cd1-7cfd-4ba5-898d-ecb792b43fd9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:08.950525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 48/90] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:08.956503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:08.972530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:08.973075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:08.973357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:08.973633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:08.974380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=c50a2ac67d964f06a3bbd3d9bb873155) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:08.974719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:08.976242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:08.985014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 43/91] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/role_assignments?user.id=c50a2ac67d964f06a3bbd3d9bb873155&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=834907900e824380a50e9ef4e00765c7 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:08.985891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:09.075690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:09.097702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52d7f7-08e4-4f91-bab5-2ed557db217b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:09.138674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158471aa-4222-43a9-aa16-56e2c1fd0e2c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:09.150693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:09.151667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:09.151991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:09.152398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:09.153263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=7c1388531c2849fcb94bee4071a75c53) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:09.153595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:09.155819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:09.157925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:09.163672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 49/92] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/role_assignments?user.id=7c1388531c2849fcb94bee4071a75c53&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:09.164284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:09.184407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:09.185051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:09.185332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:09.185609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:09.289769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:09.291525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:09.299658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979e5dc-1400-4f9b-8e15-31e982c048d5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:09.348019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:09.348721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:09.349009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:09.349290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:09.350758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:09.352408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:09.355482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 50/93] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:09 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:09.362488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:09.388059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:09.451204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 44/94] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:09.455717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:09.492828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:09.532618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f88ef-58f5-44ed-8a5e-20f12fa316b3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:09.585328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:09.585869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:09.586147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:09.586422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:09.587164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] RBAC: Adding query filter params (role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=c50a2ac67d964f06a3bbd3d9bb873155) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:09.587473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:09.588971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:09.601586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 51/95] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:09 2022] GET /identity/v3/role_assignments?user.id=c50a2ac67d964f06a3bbd3d9bb873155&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=849d3aaa045348b78fb1017e4080b01c => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:09.669879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf82a8-af1f-46b0-8043-2583bbfa2ade None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:09.740381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b84b6-ceec-4974-a11a-8f229c4a0b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:09.741064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b84b6-ceec-4974-a11a-8f229c4a0b6d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:09.741350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b84b6-ceec-4974-a11a-8f229c4a0b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:09.741629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b84b6-ceec-4974-a11a-8f229c4a0b6d None admin] PATH_INFO: `/v3/projects/a8d2c048930144e5a67f69c3e6e8e635` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:09.742911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b84b6-ceec-4974-a11a-8f229c4a0b6d None admin] RBAC: Authorizing `identity:get_project(project_id=a8d2c048930144e5a67f69c3e6e8e635)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:09.744430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b84b6-ceec-4974-a11a-8f229c4a0b6d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:09.746313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 45/96] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:09 2022] GET /identity/v3/projects/a8d2c048930144e5a67f69c3e6e8e635 => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:09.753189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:09.890419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:09.915248 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb1b6e-986e-43f4-a5a6-a90d72d53010 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:09.960942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574e0e0-0943-40d4-8ca9-47786ed5bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:09.961564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e0e0-0943-40d4-8ca9-47786ed5bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:09.961846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e0e0-0943-40d4-8ca9-47786ed5bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:09.962120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574e0e0-0943-40d4-8ca9-47786ed5bbd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:09.962852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e0e0-0943-40d4-8ca9-47786ed5bbd8 None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=a8d2c048930144e5a67f69c3e6e8e635, user.id=c50a2ac67d964f06a3bbd3d9bb873155) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:09.963161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e0e0-0943-40d4-8ca9-47786ed5bbd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:09.964647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574e0e0-0943-40d4-8ca9-47786ed5bbd8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:09.971097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 52/97] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:09 2022] GET /identity/v3/role_assignments?user.id=c50a2ac67d964f06a3bbd3d9bb873155&scope.project.id=a8d2c048930144e5a67f69c3e6e8e635&role.id=834907900e824380a50e9ef4e00765c7 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:11.896534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189dc25-e713-4509-8fd9-32da3c04c67d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:11.897144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189dc25-e713-4509-8fd9-32da3c04c67d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:11.897144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189dc25-e713-4509-8fd9-32da3c04c67d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:11.898444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 46/98] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:11.904417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64176a4-6546-41f6-a2b8-924861674656 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:11.904916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64176a4-6546-41f6-a2b8-924861674656 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:11.905018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64176a4-6546-41f6-a2b8-924861674656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:11.927386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d64176a4-6546-41f6-a2b8-924861674656 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:11.928683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d64176a4-6546-41f6-a2b8-924861674656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:12.015454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 53/99] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:12.205401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a1aa-890b-442e-87fc-2b7109fe7b7f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.205729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a1aa-890b-442e-87fc-2b7109fe7b7f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.205931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991a1aa-890b-442e-87fc-2b7109fe7b7f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:12.207519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 47/100] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:12.220172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b787-c412-44ab-ae16-c36ce6dabb0e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.220469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b787-c412-44ab-ae16-c36ce6dabb0e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.220751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b787-c412-44ab-ae16-c36ce6dabb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:12.231398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc798-29b8-40ed-8108-126de258843d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.231722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc798-29b8-40ed-8108-126de258843d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.232007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc798-29b8-40ed-8108-126de258843d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:12.233669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 48/101] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:12.243942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39ca9-615a-459d-ac93-de6b9b4bd7e9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.244230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39ca9-615a-459d-ac93-de6b9b4bd7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.244513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39ca9-615a-459d-ac93-de6b9b4bd7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:12.270071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0547b787-c412-44ab-ae16-c36ce6dabb0e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:12.271313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0547b787-c412-44ab-ae16-c36ce6dabb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:12.271576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c8c39ca9-615a-459d-ac93-de6b9b4bd7e9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:12.272966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c8c39ca9-615a-459d-ac93-de6b9b4bd7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:12.400908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 49/102] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:12.402928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 54/103] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:12.612623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c39ca9-615a-459d-ac93-de6b9b4bd7e9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:12.633486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:12.734609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c39ca9-615a-459d-ac93-de6b9b4bd7e9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:12.769893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:12.770549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.770836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.771116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:12.782142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:12.782818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b787-c412-44ab-ae16-c36ce6dabb0e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:12.787034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:12.787966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:12.788729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 50/104] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:12.798243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:12.807921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:12.875417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:12.902316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de4171-f0d7-4a6c-9a52-dfe0ecfaa03e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:12.940785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b787-c412-44ab-ae16-c36ce6dabb0e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:12.947293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effbd1c-2e49-417c-9768-3dbded412db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:12.948236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effbd1c-2e49-417c-9768-3dbded412db9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.949248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effbd1c-2e49-417c-9768-3dbded412db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.949729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effbd1c-2e49-417c-9768-3dbded412db9 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:12.950623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effbd1c-2e49-417c-9768-3dbded412db9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:12.951705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effbd1c-2e49-417c-9768-3dbded412db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:12.954154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effbd1c-2e49-417c-9768-3dbded412db9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:12.967934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 51/105] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:12.973187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6773aaf-1039-40cc-a5c9-83660cfcea9e None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.973845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6773aaf-1039-40cc-a5c9-83660cfcea9e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.973845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6773aaf-1039-40cc-a5c9-83660cfcea9e None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:12.975726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 52/106] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:12.976419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6773aaf-1039-40cc-a5c9-83660cfcea9e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:12.990665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:12.991355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:12.991682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:12.991956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.004567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:13.009485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:13.010336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:13.011108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 55/107] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:13.011795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.083891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:13.119927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6773aaf-1039-40cc-a5c9-83660cfcea9e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.124741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3ab1-91b9-4a79-b5bf-b195e56eb63f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.155430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e539df-2828-4e3d-9ed2-bebb8fdbdf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.156118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e539df-2828-4e3d-9ed2-bebb8fdbdf64 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.156415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e539df-2828-4e3d-9ed2-bebb8fdbdf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.156669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e539df-2828-4e3d-9ed2-bebb8fdbdf64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.157786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e539df-2828-4e3d-9ed2-bebb8fdbdf64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:13.159399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e539df-2828-4e3d-9ed2-bebb8fdbdf64 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:13.161305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 53/108] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:13.164487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.164859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a605-415a-4cc9-b31a-2d321373b7b5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.165126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.165241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a605-415a-4cc9-b31a-2d321373b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.165411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.165504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46a605-415a-4cc9-b31a-2d321373b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.165943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.166841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:13.168309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:13.176297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 56/109] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:13 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:13.176297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.178892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:13.190722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5e46a605-415a-4cc9-b31a-2d321373b7b5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:13.192004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5e46a605-415a-4cc9-b31a-2d321373b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:13.263150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 54/110] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:13.264621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5761-cada-4847-9a48-ba44fd5c1723 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.265517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5761-cada-4847-9a48-ba44fd5c1723 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.265803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5761-cada-4847-9a48-ba44fd5c1723 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.267089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 55/111] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:13.272277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f819c97-2be6-444f-b606-c0ba48b89ec9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.272565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f819c97-2be6-444f-b606-c0ba48b89ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.272852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f819c97-2be6-444f-b606-c0ba48b89ec9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.274174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 56/112] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:13.274790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f819c97-2be6-444f-b606-c0ba48b89ec9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.286335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00ed31-fa74-4a48-8d7e-845898315514 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.328033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.328677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.328959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.329286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.329956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:13.330418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:13.331672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:13.333202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:13.341587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 57/113] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:13.347147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.395977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f819c97-2be6-444f-b606-c0ba48b89ec9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.431649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93296ce6-8398-410a-bdbd-da49f326a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.432388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296ce6-8398-410a-bdbd-da49f326a695 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.432507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296ce6-8398-410a-bdbd-da49f326a695 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.432760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93296ce6-8398-410a-bdbd-da49f326a695 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.433429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93296ce6-8398-410a-bdbd-da49f326a695 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:13.434859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93296ce6-8398-410a-bdbd-da49f326a695 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:13.440381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:13.457304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33a59b-3aa5-4353-a6ab-0a94d575abd9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.471578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 57/114] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:15:13 2022] POST /identity/v3/projects => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:13.471578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f602-d663-4be0-96c7-3cccfdb31e7e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.471578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f602-d663-4be0-96c7-3cccfdb31e7e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.471578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f602-d663-4be0-96c7-3cccfdb31e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.495612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2ab7f602-d663-4be0-96c7-3cccfdb31e7e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:13.497618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2ab7f602-d663-4be0-96c7-3cccfdb31e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:13.507084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ccd7f-07d9-49c8-9236-236d0636d046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.508437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ccd7f-07d9-49c8-9236-236d0636d046 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.508723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ccd7f-07d9-49c8-9236-236d0636d046 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.509003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ccd7f-07d9-49c8-9236-236d0636d046 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.510854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ccd7f-07d9-49c8-9236-236d0636d046 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:13.513124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ccd7f-07d9-49c8-9236-236d0636d046 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:13.515719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 58/115] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:13 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:13.521830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068876-a83f-45b3-83cf-b1a68b9bb363 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.522119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068876-a83f-45b3-83cf-b1a68b9bb363 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.522397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068876-a83f-45b3-83cf-b1a68b9bb363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.542626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f3068876-a83f-45b3-83cf-b1a68b9bb363 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:13.543908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f3068876-a83f-45b3-83cf-b1a68b9bb363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:13.585006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 58/116] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:13.585908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f602-d663-4be0-96c7-3cccfdb31e7e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.635869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:13.646348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 59/117] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:13.648438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3068876-a83f-45b3-83cf-b1a68b9bb363 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.714217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f602-d663-4be0-96c7-3cccfdb31e7e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.732192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:13.755019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.755833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.756234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.756647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] PATH_INFO: `/v3/users/6df108019a424b27b3b0e7b2cb833251` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.771339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3068876-a83f-45b3-83cf-b1a68b9bb363 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.772550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] RBAC: Authorizing `identity:get_user(user_id=6df108019a424b27b3b0e7b2cb833251)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:13.774269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:13.776013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 59/118] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:13 2022] GET /identity/v3/users/6df108019a424b27b3b0e7b2cb833251 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:13.776793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.811616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.812985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.813802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.814346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/c50a2ac67d964f06a3bbd3d9bb873155/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.816939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=161e8f5438d748f1af7b50998d9eda1f, user_id=c50a2ac67d964f06a3bbd3d9bb873155, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:13.818678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:13.844319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 60/119] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:13 2022] PUT /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/c50a2ac67d964f06a3bbd3d9bb873155/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:13.848074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:13.899979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cea032-b0b4-47bd-89ff-1cea1c5067be None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:13.957791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:13.971609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:13.972214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:13.972479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:13.972754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:13.996746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:14.005242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:14.006164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 60/120] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:14.006903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.048828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11582e-c0b1-42e0-a6ba-e595208abfb9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.054387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:14.099174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.099899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.100188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.100464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.135828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498171d-6b45-4f81-8b22-846b2f7f219e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.177933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.178596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.178854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.179129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.190476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:14.194407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:14.195301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:14.196329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:14.197242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:14.198612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:14.201249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 61/121] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:14.202184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.273693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:14.314092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:14.322613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29378ca-7e0e-4a33-996f-71e51e20e551 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.329921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 61/122] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:14.331458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.360916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.361561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.361840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.362110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.372938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:14.383564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:14.384457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 62/123] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:14.385214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.448279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b81c0c-9e82-4075-9db2-52f315968cd4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.484880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.485756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.486034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.486304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.487140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:14.487818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:14.489714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:14.500049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 62/124] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:14.500959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.507134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1939698-01f5-468a-a52a-8c79f8c81ecf None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.528026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:14.546124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.546891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.547243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.547653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.548397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:14.548791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:14.550295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:14.560090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 63/125] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:14.561028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.588391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:14.636177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e03f4-91b6-48bb-86cb-fe1dec21dad1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.677497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.678144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.678561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.678837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.680591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:14.682488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:14.684415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 63/126] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:14.685267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.688647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf8e27-27da-488b-a5c7-1a874cd84324 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.728593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.729270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.729555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.729829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.730558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:14.730864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:14.733607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:14.747649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 64/127] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:14.748582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.794785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:14.813808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830726f-81cb-48dd-bdf3-f14370c9ee1e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.844680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:14.855972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.856705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.857170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.857738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] PATH_INFO: `/v3/users/7c1388531c2849fcb94bee4071a75c53` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.859890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1388531c2849fcb94bee4071a75c53)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:14.861474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:14.863215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 64/128] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/users/7c1388531c2849fcb94bee4071a75c53 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:14.864282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.870926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bec37a-3f24-479e-a60b-ec30bcea79e1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:14.910156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:14.910818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:14.911100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:14.911376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:14.912591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:14.914083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:14.916468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:14.917438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:14.990504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d92c5-87ba-48d2-8f10-5cc7f5e2ec31 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.029294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b01b68-2974-40ab-8f48-5a449a09b892 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.035338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.035995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.036278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.036550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.037297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] RBAC: Adding query filter params (role.id=b4f605c631114f63a32ac92acc3c5677, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=6df108019a424b27b3b0e7b2cb833251) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:15.037646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.039202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:15.050371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 65/130] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/role_assignments?user.id=6df108019a424b27b3b0e7b2cb833251&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=b4f605c631114f63a32ac92acc3c5677 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:15.050371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:15.101997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:15.115500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.116216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.116497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.116777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.122746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.124377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:15.126533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:14 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:15.127376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:15.189313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:15.204052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f606-c194-4c5f-9ab3-3f1ba8ef0ae9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.247741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.247741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.247741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.248391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.249063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.250652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:15.252823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 66/132] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:15 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:15.253619 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:15.370890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38e0de-dc66-427b-add5-8b2958f7db5a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.428161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:15.444146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.444804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.445085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.445358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] PATH_INFO: `/v3/projects/a8d2c048930144e5a67f69c3e6e8e635` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.447178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] RBAC: Authorizing `identity:get_project(project_id=a8d2c048930144e5a67f69c3e6e8e635)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.448670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:15.450336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:15 2022] GET /identity/v3/projects/a8d2c048930144e5a67f69c3e6e8e635 => generated 312 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:15.451099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:15.466548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f0fc7-e594-45f7-8cf8-3646305298f8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.504292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.504945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.505226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.505508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.506638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.508151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:15.510591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 67/134] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:15 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:15.511097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:15.641026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:15.644870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19d34-93ba-450a-8df3-5c12ffe8390d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.685613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5eeb65-1c82-4f04-aefe-d1b221630b6a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.686751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.687752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.688042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.688714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] PATH_INFO: `/v3/projects/a8d2c048930144e5a67f69c3e6e8e635/users/c50a2ac67d964f06a3bbd3d9bb873155/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.690746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8d2c048930144e5a67f69c3e6e8e635, user_id=c50a2ac67d964f06a3bbd3d9bb873155, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.692356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:15.713202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 68/135] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:15 2022] PUT /identity/v3/projects/a8d2c048930144e5a67f69c3e6e8e635/users/c50a2ac67d964f06a3bbd3d9bb873155/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:15.715854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:15.751030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:15.776974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf5a75-b3b5-445e-97d7-18f59481cc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.777714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5a75-b3b5-445e-97d7-18f59481cc62 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.777993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5a75-b3b5-445e-97d7-18f59481cc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.778269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf5a75-b3b5-445e-97d7-18f59481cc62 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/7c1388531c2849fcb94bee4071a75c53/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.786543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf5a75-b3b5-445e-97d7-18f59481cc62 None admin] RBAC: Authorizing `identity:create_grant(project_id=161e8f5438d748f1af7b50998d9eda1f, user_id=7c1388531c2849fcb94bee4071a75c53, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.789824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf5a75-b3b5-445e-97d7-18f59481cc62 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:15.820845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 68/136] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:15 2022] PUT /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/7c1388531c2849fcb94bee4071a75c53/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:15.930710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f5d2cc-274d-42f9-9e5e-c4234892b854 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:15.984722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a62bc-2f73-4eec-bdf9-d7ca018aaddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:15.985484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a62bc-2f73-4eec-bdf9-d7ca018aaddd None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:15.985775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a62bc-2f73-4eec-bdf9-d7ca018aaddd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:15.986053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a62bc-2f73-4eec-bdf9-d7ca018aaddd None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/c50a2ac67d964f06a3bbd3d9bb873155/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:15.988680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a62bc-2f73-4eec-bdf9-d7ca018aaddd None admin] RBAC: Authorizing `identity:create_grant(project_id=161e8f5438d748f1af7b50998d9eda1f, user_id=c50a2ac67d964f06a3bbd3d9bb873155, role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:15.990173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a62bc-2f73-4eec-bdf9-d7ca018aaddd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:16.008226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 69/137] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:15 2022] PUT /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/c50a2ac67d964f06a3bbd3d9bb873155/roles/849d3aaa045348b78fb1017e4080b01c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:16.350206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fff96-a2d9-4848-8d27-14fdaa71e01a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:16.350759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fff96-a2d9-4848-8d27-14fdaa71e01a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:16.350759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fff96-a2d9-4848-8d27-14fdaa71e01a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:16.352196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 69/138] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:16.359298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae9bd2-2714-48f9-b37a-c579cbce032e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:16.359613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae9bd2-2714-48f9-b37a-c579cbce032e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:16.359901 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae9bd2-2714-48f9-b37a-c579cbce032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:16.380830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-50ae9bd2-2714-48f9-b37a-c579cbce032e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:16.382055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-50ae9bd2-2714-48f9-b37a-c579cbce032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:16.451283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 70/139] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:16.602104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499710-b3cc-4367-917d-ed6dba256f6e None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:16.602365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499710-b3cc-4367-917d-ed6dba256f6e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:16.602647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b499710-b3cc-4367-917d-ed6dba256f6e None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:16.603926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 70/140] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:16.609750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6790-431f-451f-9480-5eaf3d206447 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:16.610049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6790-431f-451f-9480-5eaf3d206447 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:16.610325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e6790-431f-451f-9480-5eaf3d206447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:16.621361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:16.634658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e35e6790-431f-451f-9480-5eaf3d206447 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:16.635856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e35e6790-431f-451f-9480-5eaf3d206447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:16.723592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 71/141] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:16.830945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b499710-b3cc-4367-917d-ed6dba256f6e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:16.949518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b499710-b3cc-4367-917d-ed6dba256f6e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:16.991646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:16.992297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:16.992578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:16.992854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:17.000297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:17.001772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:17.003747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 71/142] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:17.009280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e6790-431f-451f-9480-5eaf3d206447 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:17.125896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e6790-431f-451f-9480-5eaf3d206447 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:17.156662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:17.161539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:17.162326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:17.162820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:17.163197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:17.163946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:17.165492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:17.193262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 72/143] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:15:17 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:17.223358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:17.247925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:17.379743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b185e9d-1b99-46a4-a006-9ed8e5188bb6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:17.434716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:17.435370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:17.435739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:17.436039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:17.448894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:17.454294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:17.455870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:17.456672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 72/144] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:17.461911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:17.619534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a134f-737a-4e7b-8ed4-97d0f78284bf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:17.660410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:17.661025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:17.661298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:17.661566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:17.662242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:17.662544 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:17.664017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:17.674965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 73/145] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:17.680868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:17.778216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:17.825725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555363da-9425-4757-a9e2-58e7bcd79a74 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:17.886637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:17.887515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:17.887977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:17.888476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:17.889966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:17.891702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:17.893781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 73/146] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:17 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:17.899627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:17.976665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:18.036083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef6ced-0a17-4443-802b-b9ba6202e196 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:18.083015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:18.084028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:18.084520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:18.084998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:18.161594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:18.163488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:18.213346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:18.271875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 74/147] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:18.280696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:18.420081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88c907-0826-4a4e-a814-357bbe3e7a54 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:18.463722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ea02c-c3c9-4643-ac12-70edd887a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:18.464371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ea02c-c3c9-4643-ac12-70edd887a631 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:18.464653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ea02c-c3c9-4643-ac12-70edd887a631 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:18.464929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ea02c-c3c9-4643-ac12-70edd887a631 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:18.466758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ea02c-c3c9-4643-ac12-70edd887a631 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:18.469033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ea02c-c3c9-4643-ac12-70edd887a631 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:18.470754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 74/148] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:18 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:18.477011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:18.615950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cec8d05-c13b-471b-9a88-af3eab312296 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:18.632970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb9579-c493-4d5a-9042-0365817c34ee None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:18.633727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb9579-c493-4d5a-9042-0365817c34ee None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:18.634204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb9579-c493-4d5a-9042-0365817c34ee None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:18.635899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 75/149] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:18.642342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd97ad9-930a-40ad-a143-1708c6c7ffaf None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:18.642912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd97ad9-930a-40ad-a143-1708c6c7ffaf None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:18.643390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd97ad9-930a-40ad-a143-1708c6c7ffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:18.659232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:18.667527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9dd97ad9-930a-40ad-a143-1708c6c7ffaf None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:18.669475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9dd97ad9-930a-40ad-a143-1708c6c7ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:18.673509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746f2d1-a1ab-4e79-85a3-a81faada6155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:18.674378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f2d1-a1ab-4e79-85a3-a81faada6155 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:18.674854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f2d1-a1ab-4e79-85a3-a81faada6155 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:18.675321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746f2d1-a1ab-4e79-85a3-a81faada6155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:18.676284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f2d1-a1ab-4e79-85a3-a81faada6155 None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=c50a2ac67d964f06a3bbd3d9bb873155) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:18.676807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f2d1-a1ab-4e79-85a3-a81faada6155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:18.678454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746f2d1-a1ab-4e79-85a3-a81faada6155 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:18.693291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 75/150] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:18 2022] GET /identity/v3/role_assignments?user.id=c50a2ac67d964f06a3bbd3d9bb873155&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=834907900e824380a50e9ef4e00765c7 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:18.761968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 76/151] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:19.051428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f233b9-9203-48a8-b518-896a47417f71 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:19.052005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f233b9-9203-48a8-b518-896a47417f71 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:19.052088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f233b9-9203-48a8-b518-896a47417f71 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:19.053476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 76/152] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:19.059830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76209f5-0853-43e5-9286-54bb3bf1297f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:19.060144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76209f5-0853-43e5-9286-54bb3bf1297f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:19.060382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76209f5-0853-43e5-9286-54bb3bf1297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:19.081721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f76209f5-0853-43e5-9286-54bb3bf1297f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:19.082964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f76209f5-0853-43e5-9286-54bb3bf1297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:19.168565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 77/153] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:19.233275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f233b9-9203-48a8-b518-896a47417f71 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:19.252653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:19.303921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668389b1-cc0f-495e-9b99-086cbb9946b9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:19.304123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668389b1-cc0f-495e-9b99-086cbb9946b9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:19.304398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668389b1-cc0f-495e-9b99-086cbb9946b9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:19.306002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 78/154] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:19.320020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7118-bf2d-4d7f-838c-0d12d6290ff0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:19.320297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7118-bf2d-4d7f-838c-0d12d6290ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:19.320574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd7118-bf2d-4d7f-838c-0d12d6290ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:19.352724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-96bd7118-bf2d-4d7f-838c-0d12d6290ff0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:19.353930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-96bd7118-bf2d-4d7f-838c-0d12d6290ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:19.405521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f233b9-9203-48a8-b518-896a47417f71 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:19.450746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:19.451393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:19.452198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:19.452551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:19.478193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:19.484115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:19.485348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:19.486895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 77/155] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:19.492389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:19.504879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:19.536921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 79/156] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:19.608352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:19.637036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fbd73-a251-437f-804f-f101d3196473 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:19.678960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:19.679595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:19.679873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:19.680140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:19.681098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:19.681398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:19.682798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:19.692760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 78/157] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:19.699239 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd7118-bf2d-4d7f-838c-0d12d6290ff0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:19.795296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:19.909511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd7118-bf2d-4d7f-838c-0d12d6290ff0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:19.952391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7f7b-81a3-40ef-8fc3-9adeabc472ba None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:19.989875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a1e32-ca0f-4d2e-97db-c1fc98fd90b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:19.990913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a1e32-ca0f-4d2e-97db-c1fc98fd90b7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:19.991595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a1e32-ca0f-4d2e-97db-c1fc98fd90b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:19.992025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a1e32-ca0f-4d2e-97db-c1fc98fd90b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.003975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a1e32-ca0f-4d2e-97db-c1fc98fd90b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-198a1e32-ca0f-4d2e-97db-c1fc98fd90b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:20.010091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:20.011102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:20.011910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:20.014291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 79/158] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:20.015711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:20.016231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2039-6e9d-4f2e-9964-ba1a0d05b121 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.016689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2039-6e9d-4f2e-9964-ba1a0d05b121 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.017121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c2039-6e9d-4f2e-9964-ba1a0d05b121 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.018874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 80/159] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:20.019181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f45496-717f-4ccb-8aef-2df151e50b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.020431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45496-717f-4ccb-8aef-2df151e50b29 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.020431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45496-717f-4ccb-8aef-2df151e50b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.020591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f45496-717f-4ccb-8aef-2df151e50b29 None admin] PATH_INFO: `/v3/users/6df108019a424b27b3b0e7b2cb833251` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.021530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c2039-6e9d-4f2e-9964-ba1a0d05b121 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.023673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45496-717f-4ccb-8aef-2df151e50b29 None admin] RBAC: Authorizing `identity:get_user(user_id=6df108019a424b27b3b0e7b2cb833251)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:20.025223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f45496-717f-4ccb-8aef-2df151e50b29 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:20.027195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 80/160] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:19 2022] GET /identity/v3/users/6df108019a424b27b3b0e7b2cb833251 => generated 289 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:20.028587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d24d-074a-4c06-90ab-b125fd49e468 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.028950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d24d-074a-4c06-90ab-b125fd49e468 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.029287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d24d-074a-4c06-90ab-b125fd49e468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.068584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-76a5d24d-074a-4c06-90ab-b125fd49e468 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:20.069938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-76a5d24d-074a-4c06-90ab-b125fd49e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:20.133503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c2039-6e9d-4f2e-9964-ba1a0d05b121 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:20.180305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.180891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.181174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.181444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.182518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:20.182823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:20.187578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:20.191242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:20.196132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 81/161] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:20.197326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.216921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 81/162] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:20.217858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d24d-074a-4c06-90ab-b125fd49e468 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.268154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:20.332464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16781c1a-0215-4ec0-9c03-c2adc8cbae88 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:20.371486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.372168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.372540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.372816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.374313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:20.376552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:20.383309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 82/163] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:20 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:20.384500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.394648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d24d-074a-4c06-90ab-b125fd49e468 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:20.452820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.453385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.453669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.453945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.468641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:20.473465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:20.474326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:20.475121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 82/164] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:20.475796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.504193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a403304-515a-4ce4-8bee-482a0a64a2a9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:20.532994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:20.551062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.551987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.552273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.552550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.556229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:20.557857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:20.559696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:20 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:20.560446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:20.561824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.643295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fe740-db6c-4b16-a1b6-9a312689b116 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:20.707365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.707967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.708244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.708514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/6df108019a424b27b3b0e7b2cb833251/roles/b4f605c631114f63a32ac92acc3c5677` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.710869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] RBAC: Authorizing `identity:create_grant(project_id=161e8f5438d748f1af7b50998d9eda1f, user_id=6df108019a424b27b3b0e7b2cb833251, role_id=b4f605c631114f63a32ac92acc3c5677)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:20.712750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:20.746592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 83/166] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:20 2022] PUT /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f/users/6df108019a424b27b3b0e7b2cb833251/roles/b4f605c631114f63a32ac92acc3c5677 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:20.747703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.756980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708b01b-5f7e-47a2-b1dc-c85783f508db None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:20.837192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.838069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.838484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.838958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:20.839823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:20.840312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:20.841907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:20.866978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:20.868123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:20.882152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ddb6ac-ea93-49e4-ba70-23d047e8bc8f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:20.901915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:20.930751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:20.931810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:20.932278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:20.933347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.031611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:21.033316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:21.052982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:21.175198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470471e0-547b-4510-b9bb-618aa0b929e3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:21.199319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 84/168] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:21.200245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:21.240202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:21.258052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:21.258697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:21.258971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:21.259237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.288733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:21.294771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:21.295899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:21.296881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:21.406156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec3303-0ca3-47cb-ab90-b9e5b37a45bc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:21.469392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ee413-4b7e-4932-8670-413367168775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:21.470058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ee413-4b7e-4932-8670-413367168775 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:21.470335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ee413-4b7e-4932-8670-413367168775 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:21.470603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ee413-4b7e-4932-8670-413367168775 None admin] PATH_INFO: `/v3/users/7c1388531c2849fcb94bee4071a75c53` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.476300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ee413-4b7e-4932-8670-413367168775 None admin] RBAC: Authorizing `identity:get_user(user_id=7c1388531c2849fcb94bee4071a75c53)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:21.477774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ee413-4b7e-4932-8670-413367168775 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:21.479446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 85/170] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:21 2022] GET /identity/v3/users/7c1388531c2849fcb94bee4071a75c53 => generated 247 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:21.480254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ee413-4b7e-4932-8670-413367168775 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:21.517763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82c5b6-5a8e-4bbe-a7d2-138520bca49c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:21.553390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:21.589573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:21.590232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:21.590511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:21.590785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.595201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:21.596738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:21.598533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 86/171] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:21 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:21.599312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:21.619926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:21.653301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ee413-4b7e-4932-8670-413367168775 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:21.691016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:21.691668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:21.691948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:21.692219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.692889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:21.693194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:21.694576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:21.704491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 86/172] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:21.705358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:21.808242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37127621-e73b-4d90-b31d-2e95857d7f55 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:21.841892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48123771-78b6-4f7b-af9f-a79af0f0c6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:21.842560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123771-78b6-4f7b-af9f-a79af0f0c6ec None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:21.842914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123771-78b6-4f7b-af9f-a79af0f0c6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:21.843261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48123771-78b6-4f7b-af9f-a79af0f0c6ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.844032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48123771-78b6-4f7b-af9f-a79af0f0c6ec None admin] RBAC: Adding query filter params (role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=c50a2ac67d964f06a3bbd3d9bb873155) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:21.844343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48123771-78b6-4f7b-af9f-a79af0f0c6ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:21.844877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44a5c3-9274-492f-b58a-e27f9f52915f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:21.845940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48123771-78b6-4f7b-af9f-a79af0f0c6ec None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:21.852136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 87/173] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:21 2022] GET /identity/v3/role_assignments?user.id=c50a2ac67d964f06a3bbd3d9bb873155&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=849d3aaa045348b78fb1017e4080b01c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:21.853355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee272523-dd0d-43c0-95b3-bfed18eef351 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:21.853635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee272523-dd0d-43c0-95b3-bfed18eef351 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:21.853910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee272523-dd0d-43c0-95b3-bfed18eef351 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.860094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 88/174] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:21.860976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee272523-dd0d-43c0-95b3-bfed18eef351 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:21.879324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:21.920421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa25fcf-c9d5-4c20-b3b0-904b3d4c93be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:21.921154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25fcf-c9d5-4c20-b3b0-904b3d4c93be None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:21.921436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25fcf-c9d5-4c20-b3b0-904b3d4c93be None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:21.921717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa25fcf-c9d5-4c20-b3b0-904b3d4c93be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:21.998906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee272523-dd0d-43c0-95b3-bfed18eef351 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:22.031992 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:22.036856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103aad1-4482-4715-9e11-4b9ac26410b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:22.037520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103aad1-4482-4715-9e11-4b9ac26410b1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.037797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103aad1-4482-4715-9e11-4b9ac26410b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.038066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103aad1-4482-4715-9e11-4b9ac26410b1 None admin] PATH_INFO: `/v3/users/c50a2ac67d964f06a3bbd3d9bb873155` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.039578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103aad1-4482-4715-9e11-4b9ac26410b1 None admin] RBAC: Authorizing `identity:get_user(user_id=c50a2ac67d964f06a3bbd3d9bb873155)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:22.040841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103aad1-4482-4715-9e11-4b9ac26410b1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:22.042470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 89/175] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:21 2022] GET /identity/v3/users/c50a2ac67d964f06a3bbd3d9bb873155 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:22.043683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbadeb-9f90-491e-86ed-d6c0de8f6dd6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.043959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbadeb-9f90-491e-86ed-d6c0de8f6dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.044226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbadeb-9f90-491e-86ed-d6c0de8f6dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.058563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25fcf-c9d5-4c20-b3b0-904b3d4c93be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:22.060241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa25fcf-c9d5-4c20-b3b0-904b3d4c93be None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:22.084868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a1fbadeb-9f90-491e-86ed-d6c0de8f6dd6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:22.086118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a1fbadeb-9f90-491e-86ed-d6c0de8f6dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:22.178653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 90/176] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:22.180590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbadeb-9f90-491e-86ed-d6c0de8f6dd6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:22.188182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:22.252181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 87/177] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:22.254143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294285d-9f6b-42c0-8fb1-ca17d782a513 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.254641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294285d-9f6b-42c0-8fb1-ca17d782a513 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.255105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294285d-9f6b-42c0-8fb1-ca17d782a513 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.262056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 88/178] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:22.263752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63257-f88d-45cf-a82e-ef31daeb3153 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.264275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63257-f88d-45cf-a82e-ef31daeb3153 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.265476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e63257-f88d-45cf-a82e-ef31daeb3153 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.267149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 89/179] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:22.268122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e63257-f88d-45cf-a82e-ef31daeb3153 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:22.282255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbadeb-9f90-491e-86ed-d6c0de8f6dd6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:22.320191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee25437-da9f-44aa-9030-50a2adc63c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:22.321091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee25437-da9f-44aa-9030-50a2adc63c6f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.321380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee25437-da9f-44aa-9030-50a2adc63c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.321653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee25437-da9f-44aa-9030-50a2adc63c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.396508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:22.399755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee25437-da9f-44aa-9030-50a2adc63c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:22.401234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee25437-da9f-44aa-9030-50a2adc63c6f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:22.412249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:22.420383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e63257-f88d-45cf-a82e-ef31daeb3153 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:22.463819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c507-a71a-4cff-a53c-72696d51206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:22.464706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c507-a71a-4cff-a53c-72696d51206f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.464986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c507-a71a-4cff-a53c-72696d51206f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.465684 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c507-a71a-4cff-a53c-72696d51206f None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.466821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c507-a71a-4cff-a53c-72696d51206f None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:22.468396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120c507-a71a-4cff-a53c-72696d51206f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:22.471047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 90/180] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:22 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:22.472356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab538e-37c6-4364-9159-fb37a0ad255a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.472641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab538e-37c6-4364-9159-fb37a0ad255a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.472913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab538e-37c6-4364-9159-fb37a0ad255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.496989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e7ab538e-37c6-4364-9159-fb37a0ad255a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:22.499069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e7ab538e-37c6-4364-9159-fb37a0ad255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:22.526273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 91/181] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:22.527936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85833e92-e191-45d0-9ab1-638bd1e76a04 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.528219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85833e92-e191-45d0-9ab1-638bd1e76a04 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.528749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85833e92-e191-45d0-9ab1-638bd1e76a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.549018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-85833e92-e191-45d0-9ab1-638bd1e76a04 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:22.550598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-85833e92-e191-45d0-9ab1-638bd1e76a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:22.577734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 91/182] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:22.578521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab538e-37c6-4364-9159-fb37a0ad255a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:22.636903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 92/183] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:22.640474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85833e92-e191-45d0-9ab1-638bd1e76a04 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:22.686876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:22.708908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab538e-37c6-4364-9159-fb37a0ad255a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:22.713683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:22.770722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:22.771350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.771654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.771931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.772668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=7c1388531c2849fcb94bee4071a75c53) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:22.772977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:22.775226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:22.787994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 92/184] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:22 2022] GET /identity/v3/role_assignments?user.id=7c1388531c2849fcb94bee4071a75c53&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:22.788625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:22.849729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85833e92-e191-45d0-9ab1-638bd1e76a04 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:22.948551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:22.949206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:22.949479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:22.949746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] PATH_INFO: `/v3/projects/a8d2c048930144e5a67f69c3e6e8e635` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:22.961028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] RBAC: Authorizing `identity:get_project(project_id=a8d2c048930144e5a67f69c3e6e8e635)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:22.961028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:22.961453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 93/185] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:22 2022] GET /identity/v3/projects/a8d2c048930144e5a67f69c3e6e8e635 => generated 312 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:22.962340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.075929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d8c3-1158-437e-a2ee-be2e241aa5ee None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.143064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.143310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.143528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.143848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.161319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:23.162850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42da80-6b3e-4ff6-ba33-bb4e528e866a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.166772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:23.167037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:23.167928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 93/186] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:23.169201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.178439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:23.225887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.227000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.227474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.228106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.229638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:23.231437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:23.234484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 94/187] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:23.235578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.316534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be138-1bf2-462f-930e-04e7866c7f3c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.368453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.369878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.370607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.371092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.372518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=a8d2c048930144e5a67f69c3e6e8e635, user.id=c50a2ac67d964f06a3bbd3d9bb873155) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:23.373318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:23.375299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:23.381221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c981b24-2d87-47a6-b245-1cde2463d3e5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.391573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/role_assignments?user.id=c50a2ac67d964f06a3bbd3d9bb873155&scope.project.id=a8d2c048930144e5a67f69c3e6e8e635&role.id=834907900e824380a50e9ef4e00765c7 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:23.391573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.430423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.431751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.432035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.432309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.448251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:23.455937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:23.456893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:23.457692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:23.459975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 95/189] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:23.460600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.477655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:23.509533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:23.522850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e348d7-b74d-48e5-84cf-2669c80cfa67 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.566415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.567483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.568066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.568535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.569514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:23.570058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:23.571889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:23.586469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 95/190] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:23.586469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.597328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8177f-9914-4e69-9e1d-ed4dee194f99 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.643517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.644213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.644461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.645156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.645837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:23.647452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:23.678789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 96/191] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:15:23 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:23.679469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.702422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd251dc-5022-4280-95c8-d87a18eeede3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.743741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:23.751943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c5882-bc93-4380-b7f0-410e3f07fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.752598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c5882-bc93-4380-b7f0-410e3f07fa92 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.752934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c5882-bc93-4380-b7f0-410e3f07fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.753203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c5882-bc93-4380-b7f0-410e3f07fa92 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.753928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c5882-bc93-4380-b7f0-410e3f07fa92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:23.754230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c5882-bc93-4380-b7f0-410e3f07fa92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:23.755699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c5882-bc93-4380-b7f0-410e3f07fa92 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:23.764900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 96/192] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:23.766175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe7cb-9657-44db-84f3-8d3e8c9e17d0 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.766461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe7cb-9657-44db-84f3-8d3e8c9e17d0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.766731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbe7cb-9657-44db-84f3-8d3e8c9e17d0 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.768222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 97/193] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:23.773728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbe7cb-9657-44db-84f3-8d3e8c9e17d0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.799621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:23.815776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5ea08-4b15-44da-850c-3ca3c4bd126b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.852162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faadda7-5443-4975-9944-883614b9c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.852835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faadda7-5443-4975-9944-883614b9c04e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.853104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faadda7-5443-4975-9944-883614b9c04e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.853375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faadda7-5443-4975-9944-883614b9c04e None admin] PATH_INFO: `/v3/users/ec6b460fb3394ce79a47ae75846c2ce2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.870470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faadda7-5443-4975-9944-883614b9c04e None admin] RBAC: Authorizing `identity:get_user(user_id=ec6b460fb3394ce79a47ae75846c2ce2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:23.871577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faadda7-5443-4975-9944-883614b9c04e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:23.872896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 97/194] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/users/ec6b460fb3394ce79a47ae75846c2ce2 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:23.874987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec843-93f0-4ef6-ad35-cd5996ac1204 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.874987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec843-93f0-4ef6-ad35-cd5996ac1204 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.874987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dec843-93f0-4ef6-ad35-cd5996ac1204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.895845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-80dec843-93f0-4ef6-ad35-cd5996ac1204 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:23.897036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-80dec843-93f0-4ef6-ad35-cd5996ac1204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:23.897259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbe7cb-9657-44db-84f3-8d3e8c9e17d0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:23.935355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:23.936042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:23.936421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:23.936691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] PATH_INFO: `/v3/users/ec6b460fb3394ce79a47ae75846c2ce2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:23.941069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] RBAC: Authorizing `identity:get_user(user_id=ec6b460fb3394ce79a47ae75846c2ce2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:23.943577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:23.944529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 98/195] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/users/ec6b460fb3394ce79a47ae75846c2ce2 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:23.945330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:23.974426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 98/196] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:23.975197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec843-93f0-4ef6-ad35-cd5996ac1204 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:24.027144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.068829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.082138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d4da1-99ea-4533-9d3a-602e0c76d8cd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.090788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dec843-93f0-4ef6-ad35-cd5996ac1204 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.127570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.128525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.129076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.129378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.132845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.133570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.133844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.134110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.208284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:24.209787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:24.217437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:24.219002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:24.273360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.319995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.321999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 99/197] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:24.327310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:24.353872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 99/198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:24.354961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:24.460976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b428a5-ba52-4b46-97bf-578c8480a011 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.465290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a9a38-1955-4578-850b-d6f200cfe78b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.501550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.502443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.502866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.503280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.505533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.506276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.507016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.507402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.508664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:24.510462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:24.515603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 100/199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:24 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:24.515603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:24.520821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:24.526051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:24.526908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:24.528322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:24.529037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:24.559831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.567310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.626568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e3a51-560c-4259-afa6-2d51cca6174d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.654718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437228d1-a8b7-4ebb-9336-ce6b4f0faec7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.663086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.664284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.664708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.665143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.666409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:24.668049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:24.669863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:24 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:24.670814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:24.699129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.699795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.700314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.700593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.701335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=ec6b460fb3394ce79a47ae75846c2ce2) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:24.701640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:24.703863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:24.719220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:24 2022] GET /identity/v3/role_assignments?user.id=ec6b460fb3394ce79a47ae75846c2ce2&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:24.719220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:24.821924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.842807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971e3ec-e006-4b26-ad68-07690106fb72 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.878039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4371-71e6-43f4-8f72-f4b0f4a8a9fe None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:24.885783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.886492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.886796 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.887065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.887988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] RBAC: Adding query filter params (role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=ec6b460fb3394ce79a47ae75846c2ce2) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:24.888298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:24.890485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:24.897868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:24 2022] GET /identity/v3/role_assignments?user.id=ec6b460fb3394ce79a47ae75846c2ce2&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=849d3aaa045348b78fb1017e4080b01c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:24.909476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:24.945729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:24.946757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:24.947197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:24.947699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:24.948650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:24.949158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:24.950807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:24.965961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:24.972105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:25.102857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744b5d1-49ed-4d4f-b833-2c8c64441584 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:25.138673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:25.139391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:25.139701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:25.140063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] PATH_INFO: `/v3/users/6df108019a424b27b3b0e7b2cb833251` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:25.141160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] RBAC: Authorizing `identity:get_user(user_id=6df108019a424b27b3b0e7b2cb833251)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:25.142612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:25.144514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:24 2022] GET /identity/v3/users/6df108019a424b27b3b0e7b2cb833251 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:25.149778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:25.287867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f67e28-d99e-4239-a3bb-90114324b74f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:25.331009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:25.331667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:25.331951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:25.332222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:25.390311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:25.425628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:25.427119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:25.556935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:25.562566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:25.596615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:25.716294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c44492-b76c-4692-8d47-5ded7aa79d8b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:25.753081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609d3c-3a44-436d-a8ad-195e392e3569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:25.754108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609d3c-3a44-436d-a8ad-195e392e3569 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:25.754575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609d3c-3a44-436d-a8ad-195e392e3569 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:25.755032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609d3c-3a44-436d-a8ad-195e392e3569 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:25.756406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609d3c-3a44-436d-a8ad-195e392e3569 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:25.758057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609d3c-3a44-436d-a8ad-195e392e3569 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:25.760193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:25 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:25.767571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:25.861001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:25.886995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ba7bc-2da2-4fea-911f-d3680bd05bbd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:25.933606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a93c30-47ac-42b8-977e-188126c559f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:25.934226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93c30-47ac-42b8-977e-188126c559f2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:25.934503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93c30-47ac-42b8-977e-188126c559f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:25.934773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a93c30-47ac-42b8-977e-188126c559f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:25.935510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a93c30-47ac-42b8-977e-188126c559f2 None admin] RBAC: Adding query filter params (role.id=b4f605c631114f63a32ac92acc3c5677, scope.project.id=161e8f5438d748f1af7b50998d9eda1f, user.id=6df108019a424b27b3b0e7b2cb833251) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:25.935842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a93c30-47ac-42b8-977e-188126c559f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:25.937493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a93c30-47ac-42b8-977e-188126c559f2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:25.944485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:25 2022] GET /identity/v3/role_assignments?user.id=6df108019a424b27b3b0e7b2cb833251&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=b4f605c631114f63a32ac92acc3c5677 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:26.352047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a561bf-2dda-4093-9e57-a8b480d2007f None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:26.352705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a561bf-2dda-4093-9e57-a8b480d2007f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:26.353166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a561bf-2dda-4093-9e57-a8b480d2007f None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:26.354993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:26.361234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324ed7-0c14-4fc5-a5f7-401d40d6fd28 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:26.361518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324ed7-0c14-4fc5-a5f7-401d40d6fd28 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:26.361792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324ed7-0c14-4fc5-a5f7-401d40d6fd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:26.383172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bc324ed7-0c14-4fc5-a5f7-401d40d6fd28 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:26.384468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bc324ed7-0c14-4fc5-a5f7-401d40d6fd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:26.462966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 105/210] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:26.666916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f15348-0bae-4919-8b27-bda43c9388aa None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:26.667987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f15348-0bae-4919-8b27-bda43c9388aa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:26.668739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f15348-0bae-4919-8b27-bda43c9388aa None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:26.670266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 106/211] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:26.675780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ad25-5ac7-4ec6-8ade-88a39f663f66 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:26.676286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ad25-5ac7-4ec6-8ade-88a39f663f66 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:26.676772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ad25-5ac7-4ec6-8ade-88a39f663f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:26.695634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8d69ad25-5ac7-4ec6-8ade-88a39f663f66 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:26.697088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8d69ad25-5ac7-4ec6-8ade-88a39f663f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:26.756180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f15348-0bae-4919-8b27-bda43c9388aa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:26.759429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:26.771693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 106/212] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:26.853071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:26.870473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f15348-0bae-4919-8b27-bda43c9388aa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:26.908501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:26.909204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:26.909483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:26.909808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:26.920548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:26.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:26.927224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:26.928040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:26.931945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 107/213] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:26.933960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69ad25-5ac7-4ec6-8ade-88a39f663f66 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.036842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69ad25-5ac7-4ec6-8ade-88a39f663f66 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:27.065157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.071415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:27.072083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.072348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.072621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.073295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:27.073599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:27.074991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:27.086832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 107/214] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:27.093484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.164905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:27.194370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578df01-d673-4b24-8284-781e713ad974 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:27.217241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dea7a90-b843-46b9-a5d4-008e599bf44c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:27.237221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:27.238013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.238293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.238564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.239993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:27.241500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:27.247781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 108/215] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:27.250096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.265189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0448c8-68a5-4695-9af2-50aaaf426ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:27.266180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0448c8-68a5-4695-9af2-50aaaf426ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.266702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0448c8-68a5-4695-9af2-50aaaf426ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.267114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0448c8-68a5-4695-9af2-50aaaf426ce2 None admin] PATH_INFO: `/v3/users/81b0041497a64a3f81795b2089c240b6` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.272570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:27.287841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0448c8-68a5-4695-9af2-50aaaf426ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=81b0041497a64a3f81795b2089c240b6)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:27.290040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0448c8-68a5-4695-9af2-50aaaf426ce2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:27.292352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 108/216] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:27 2022] GET /identity/v3/users/81b0041497a64a3f81795b2089c240b6 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:27.297110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50bc3c-7280-4d46-a5a8-07869525f05c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.297241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50bc3c-7280-4d46-a5a8-07869525f05c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.297411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50bc3c-7280-4d46-a5a8-07869525f05c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.299571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 109/217] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:27.304218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50bc3c-7280-4d46-a5a8-07869525f05c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.378725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51a80d-bee0-498e-8a8c-811ab77cc4c7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:27.417979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea294b6-7fa4-4350-8aee-ee6522be26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:27.418598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea294b6-7fa4-4350-8aee-ee6522be26a8 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.418877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea294b6-7fa4-4350-8aee-ee6522be26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.419148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea294b6-7fa4-4350-8aee-ee6522be26a8 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.419846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea294b6-7fa4-4350-8aee-ee6522be26a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:27.420006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50bc3c-7280-4d46-a5a8-07869525f05c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:27.421347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea294b6-7fa4-4350-8aee-ee6522be26a8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:27.440576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:27.446659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 109/218] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:15:27 2022] POST /identity/v3/users => generated 297 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:27.457551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190e91a-6e2f-4044-84d0-0d032ca7c0d2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.458179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190e91a-6e2f-4044-84d0-0d032ca7c0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.458652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190e91a-6e2f-4044-84d0-0d032ca7c0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.459806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:27.460439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.460716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.460988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.486759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5190e91a-6e2f-4044-84d0-0d032ca7c0d2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:27.488029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5190e91a-6e2f-4044-84d0-0d032ca7c0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:27.549475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:27.550941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:27.561717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:27.568722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 110/219] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:27.570141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b10786-eac8-4b05-970b-b94c0d7b8b61 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.570839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b10786-eac8-4b05-970b-b94c0d7b8b61 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.571464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b10786-eac8-4b05-970b-b94c0d7b8b61 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.573256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 111/220] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:27.579837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f57f-f689-44f9-b491-f0ecd13c3698 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.580145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f57f-f689-44f9-b491-f0ecd13c3698 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.580393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f57f-f689-44f9-b491-f0ecd13c3698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.600524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a231f57f-f689-44f9-b491-f0ecd13c3698 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:27.601798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a231f57f-f689-44f9-b491-f0ecd13c3698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:27.685494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 112/221] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:27.687625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 110/222] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:27.697123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f57f-f689-44f9-b491-f0ecd13c3698 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.806515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f57f-f689-44f9-b491-f0ecd13c3698 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:27.838480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:27.845659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:27.846311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:27.846591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:27.846864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:27.848126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:27.849573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:27.851454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 113/223] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:27 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:27.852599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.858194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:27.879130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:27.988467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0fc08-9151-47f4-98eb-eb13f25a46f7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:27.992799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e2feb-c9da-457d-bd34-c18673c5e617 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:28.032287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.032939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.033222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.033499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.038719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.039745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.040225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.040713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.041912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=81b0041497a64a3f81795b2089c240b6) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:28.042780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:28.044834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:28.045110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:28.051178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:28.052127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:28.052946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 111/224] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:28.053604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.054625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 114/225] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:27 2022] GET /identity/v3/role_assignments?user.id=81b0041497a64a3f81795b2089c240b6&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=834907900e824380a50e9ef4e00765c7 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:28.059948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.189834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:28.242154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:28.270317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dee66-87a3-4ebf-a9a8-1081402db152 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:28.288587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e203ab-6bf7-4e9f-a4d7-f897751288ab None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:28.321136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.321582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.321860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.322132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.322804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:28.323098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:28.324515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:28.331448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.332669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.333157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.333642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.334238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 115/226] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:28.341830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.346523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:28.351774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:28.352641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:28.353436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:28.355843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 112/227] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:28.367773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.495906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb249d-ac54-496d-9e25-69f2db358bef None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:28.537463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.538665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.539140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.539644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.540508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:28.541016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:28.542658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:28.550274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:28.554504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 113/228] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:28.570632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe78771-6cd4-44bf-be05-dc754b608f7a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:28.574885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.622150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:28.645696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.646343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.646620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.646886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] PATH_INFO: `/v3/users/ec6b460fb3394ce79a47ae75846c2ce2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.652372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] RBAC: Authorizing `identity:get_user(user_id=ec6b460fb3394ce79a47ae75846c2ce2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:28.653937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:28.656079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 116/229] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:28 2022] GET /identity/v3/users/ec6b460fb3394ce79a47ae75846c2ce2 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:28.661235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.699381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d48ec-8db5-487e-a529-8742f7c976bf None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:28.739791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.740894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.741369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.741829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] PATH_INFO: `/v3/users/ec6b460fb3394ce79a47ae75846c2ce2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.748385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] RBAC: Authorizing `identity:get_user(user_id=ec6b460fb3394ce79a47ae75846c2ce2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:28.750778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:28.754807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:28 2022] GET /identity/v3/users/ec6b460fb3394ce79a47ae75846c2ce2 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:28.759973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.862915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c66ef-1615-4191-8655-825d8fbcba61 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:28.911935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:28.932101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:28.933138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:28.933612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:28.934083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:28.937884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:28.939999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:28.946146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 117/231] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:28 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:28.947823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:28.975716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96222f1b-9839-4f78-a771-38670330d2ca None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:29.013808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:29.015303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:29.015827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:29.016290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:29.017712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:29.019416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:29.022539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:28 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:29.029668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:29.068230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:29.146206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccfee1-e1f5-49a2-b9fb-2dcc94a687ae None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:29.152692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659ac06-13c5-4f6b-90d8-8816b197389d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:29.182193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a435c-d4e4-4150-9650-6ee37bd81f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:29.183046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a435c-d4e4-4150-9650-6ee37bd81f15 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:29.183326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a435c-d4e4-4150-9650-6ee37bd81f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:29.183628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a435c-d4e4-4150-9650-6ee37bd81f15 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/ec6b460fb3394ce79a47ae75846c2ce2/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:29.185902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a435c-d4e4-4150-9650-6ee37bd81f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=65df074f839b49e3a0dbada68f63cc52, user_id=ec6b460fb3394ce79a47ae75846c2ce2, role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:29.187523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a435c-d4e4-4150-9650-6ee37bd81f15 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:29.191930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:29.210208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 116/233] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:29 2022] PUT /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/ec6b460fb3394ce79a47ae75846c2ce2/roles/849d3aaa045348b78fb1017e4080b01c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:29.222333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fbe30-c17d-4deb-8bac-75bc03c4f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:29.223068 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbe30-c17d-4deb-8bac-75bc03c4f380 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:29.223447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbe30-c17d-4deb-8bac-75bc03c4f380 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:29.223751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fbe30-c17d-4deb-8bac-75bc03c4f380 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/ec6b460fb3394ce79a47ae75846c2ce2/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:29.225733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fbe30-c17d-4deb-8bac-75bc03c4f380 None admin] RBAC: Authorizing `identity:create_grant(project_id=65df074f839b49e3a0dbada68f63cc52, user_id=ec6b460fb3394ce79a47ae75846c2ce2, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:29.227500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0fbe30-c17d-4deb-8bac-75bc03c4f380 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:29.246544 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 118/234] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:28 2022] PUT /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/ec6b460fb3394ce79a47ae75846c2ce2/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:30.143932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7945db-841d-4d23-a40a-296f7354f80b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:30.145008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7945db-841d-4d23-a40a-296f7354f80b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:30.145491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7945db-841d-4d23-a40a-296f7354f80b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:30.147329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 117/235] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:30.152935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125f99f-6728-419f-ba6b-7836a160f35c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:30.153747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125f99f-6728-419f-ba6b-7836a160f35c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:30.154261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125f99f-6728-419f-ba6b-7836a160f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:30.184627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a125f99f-6728-419f-ba6b-7836a160f35c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:30.186350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a125f99f-6728-419f-ba6b-7836a160f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:30.213173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122d8a-7ba6-4569-a224-9e072bad8f9f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:30.213810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122d8a-7ba6-4569-a224-9e072bad8f9f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:30.214283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df122d8a-7ba6-4569-a224-9e072bad8f9f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:30.215865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 118/236] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:30.221685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9323-be61-4f77-9ab9-2f1cf8f710ea None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:30.221966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9323-be61-4f77-9ab9-2f1cf8f710ea None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:30.222240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec9323-be61-4f77-9ab9-2f1cf8f710ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:30.251145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fbec9323-be61-4f77-9ab9-2f1cf8f710ea None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:30.252914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fbec9323-be61-4f77-9ab9-2f1cf8f710ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:30.311515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 119/237] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:30.383303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 119/238] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:30.690881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125f99f-6728-419f-ba6b-7836a160f35c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:30.723144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af972-a4bf-439c-93e5-4d8fd0e108c3 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:30.723429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af972-a4bf-439c-93e5-4d8fd0e108c3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:30.723772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924af972-a4bf-439c-93e5-4d8fd0e108c3 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:30.725355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 120/239] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:30.730383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462dea-9fd6-4f06-8b57-bb4ca445d80a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:30.730670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462dea-9fd6-4f06-8b57-bb4ca445d80a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:30.730946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a462dea-9fd6-4f06-8b57-bb4ca445d80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:30.764188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0a462dea-9fd6-4f06-8b57-bb4ca445d80a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:30.765536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:30.768442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0a462dea-9fd6-4f06-8b57-bb4ca445d80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:30.832375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125f99f-6728-419f-ba6b-7836a160f35c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:30.863563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 121/240] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:30.869202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462dea-9fd6-4f06-8b57-bb4ca445d80a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:30.872153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:30.873089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:30.873588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:30.874004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:30.885820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:30.891430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:30.892627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:30.893652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:30.895795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 120/241] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:30.901540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:30.939961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:31.011710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a462dea-9fd6-4f06-8b57-bb4ca445d80a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.029488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7550-11f6-4ddb-a1f6-0119e586c382 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.052422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:31.063234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.064244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.064521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.064786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.070000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.071494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.073263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 122/242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:31.081600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.102820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.103437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.103750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.104024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.104712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:31.105006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.106394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.124242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 121/243] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:31.129316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.238693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a32e-29bf-4159-983c-a503e73fa967 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.239802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15709df3-8a40-4521-80ef-8d0f63cbee2c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.262788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:31.274704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.275413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.275840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.276263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.277602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.281437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.289126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.289959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.290380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.290816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] PATH_INFO: `/v3/users/8dc8dac3096f4983b6f0b2c7a3ada02d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.307288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] RBAC: Authorizing `identity:get_user(user_id=8dc8dac3096f4983b6f0b2c7a3ada02d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.309289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.311469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 122/244] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:31 2022] GET /identity/v3/users/8dc8dac3096f4983b6f0b2c7a3ada02d => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:31.312363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.315841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 123/245] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:15:31 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:31.321655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.374862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:31.525207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1eafb-6e0f-4090-a6b9-7952cf5a6b62 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.531427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28b4a-0794-4166-af3c-bfd306b7ba87 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.583185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.585075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.585357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.585634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.587642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.588288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.588569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.588884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.601923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:31.607065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:31.608152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:31.608927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 123/246] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:31.615043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.642645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:31.662950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.664790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.719925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:31.730046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3662a1-7b65-4c60-9221-8faa23644703 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.768631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.769264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.769544 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.769816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.770216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 124/247] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:31.770511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:31.770817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.774478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.776195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.784211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 124/248] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:31.790539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.883912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:31.896831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e952b-c3aa-453a-9809-42148bf29b80 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.904318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9bc69-c204-4626-8c66-bd7dbfcb0717 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:31.937036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d19efb-e9ca-442d-aba0-67a02087012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.937681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19efb-e9ca-442d-aba0-67a02087012d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.939907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19efb-e9ca-442d-aba0-67a02087012d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.939907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d19efb-e9ca-442d-aba0-67a02087012d None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.939907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d19efb-e9ca-442d-aba0-67a02087012d None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.943176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d19efb-e9ca-442d-aba0-67a02087012d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.943305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 125/249] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:31 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:31.943472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5dc1f-5229-4bff-b13d-6a71caa19be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:31.944081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5dc1f-5229-4bff-b13d-6a71caa19be4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.944358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5dc1f-5229-4bff-b13d-6a71caa19be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.944685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5dc1f-5229-4bff-b13d-6a71caa19be4 None admin] PATH_INFO: `/v3/users/81b0041497a64a3f81795b2089c240b6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.945216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fe8d0-7f3b-4d21-ae3b-84c77b83de26 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.945496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fe8d0-7f3b-4d21-ae3b-84c77b83de26 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.945764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74fe8d0-7f3b-4d21-ae3b-84c77b83de26 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.945860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5dc1f-5229-4bff-b13d-6a71caa19be4 None admin] RBAC: Authorizing `identity:get_user(user_id=81b0041497a64a3f81795b2089c240b6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:31.946970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 126/250] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:31.947420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5dc1f-5229-4bff-b13d-6a71caa19be4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:31.947985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76400a7-dd97-4928-983d-8635e8e4810a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.948257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76400a7-dd97-4928-983d-8635e8e4810a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.948585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76400a7-dd97-4928-983d-8635e8e4810a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.949421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 125/251] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:31 2022] GET /identity/v3/users/81b0041497a64a3f81795b2089c240b6 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:31.949758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 127/252] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:31.953942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76400a7-dd97-4928-983d-8635e8e4810a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:31.954813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097ec5-0fb1-4436-8b7d-7e30935882ad None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:31.955110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097ec5-0fb1-4436-8b7d-7e30935882ad None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:31.955380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097ec5-0fb1-4436-8b7d-7e30935882ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:31.976616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c5097ec5-0fb1-4436-8b7d-7e30935882ad None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:31.977801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c5097ec5-0fb1-4436-8b7d-7e30935882ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:31.996065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:32.068496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 126/253] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:32.068496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a8d6-b8e9-43c7-900c-757c70f68019 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:32.068496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a8d6-b8e9-43c7-900c-757c70f68019 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:32.068496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a8d6-b8e9-43c7-900c-757c70f68019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:32.089184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5574a8d6-b8e9-43c7-900c-757c70f68019 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:32.090473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5574a8d6-b8e9-43c7-900c-757c70f68019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:32.106183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76400a7-dd97-4928-983d-8635e8e4810a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:32.173975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:32.174588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:32.174859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:32.175124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:32.175891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] RBAC: Adding query filter params (role.id=b4f605c631114f63a32ac92acc3c5677, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=8dc8dac3096f4983b6f0b2c7a3ada02d) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:32.176191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:32.177664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:32.186761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 128/254] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:31 2022] GET /identity/v3/role_assignments?user.id=8dc8dac3096f4983b6f0b2c7a3ada02d&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=b4f605c631114f63a32ac92acc3c5677 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:32.189245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:32.200723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 127/255] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:32.222548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:32.349579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd4fc-9293-41ab-91a9-0ea275bcd286 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:32.384871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:32.385512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:32.385785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:32.386116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:32.387343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:32.388996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:32.391522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 129/256] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:32 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:32.397288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a8d6-b8e9-43c7-900c-757c70f68019 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:32.530229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:32.538766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:32.559593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a8d6-b8e9-43c7-900c-757c70f68019 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:32.628337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:32.629164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:32.629448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:32.629719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/81b0041497a64a3f81795b2089c240b6/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:32.632259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] RBAC: Authorizing `identity:create_grant(project_id=65df074f839b49e3a0dbada68f63cc52, user_id=81b0041497a64a3f81795b2089c240b6, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:32.636267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:32.654968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 128/257] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:32 2022] PUT /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/81b0041497a64a3f81795b2089c240b6/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:32.655849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:32.718961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:32.769947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f67fb-a7e0-4fbd-9e1b-735441c5b13a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:32.861102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:32.861771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:32.862035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:32.862298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:32.876120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54968907-1fef-4d7a-9ea5-8bef78a41312 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:32.900445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:32.906138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:32.907010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:32.907873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 130/258] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:32.921162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:32.946205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:32.947270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:32.947776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:32.948267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:32.964141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:32.971935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:32.981292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:32.982229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:32.983424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 129/259] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:32.991638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:33.117217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339502b-b60d-484c-9274-8e3a478e1a61 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:33.172697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4554-1d5b-4e0a-a2b2-5a36f5710b1b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:33.182397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:33.183019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:33.183388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:33.183684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:33.184420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:33.184720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:33.186142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:33.202100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 131/260] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:33.206459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:33.212189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:33.241908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:33.242824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:33.243265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:33.243747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:33.244634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:33.245163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:33.246760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:33.262481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:33.269855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:33.407528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:33.420377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c2201-0afd-41f3-a34a-cf445398fd16 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:33.472532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:33.473603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:33.474054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:33.474492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] PATH_INFO: `/v3/users/ec6b460fb3394ce79a47ae75846c2ce2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:33.475948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] RBAC: Authorizing `identity:get_user(user_id=ec6b460fb3394ce79a47ae75846c2ce2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:33.478066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:33.480371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 132/262] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:33 2022] GET /identity/v3/users/ec6b460fb3394ce79a47ae75846c2ce2 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:33.487600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39db1-aa1f-40ab-bd6e-8231ea71492c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:33.490884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:33.571204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:33.571958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:33.572245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:33.572520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] PATH_INFO: `/v3/users/ec6b460fb3394ce79a47ae75846c2ce2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:33.574821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] RBAC: Authorizing `identity:get_user(user_id=ec6b460fb3394ce79a47ae75846c2ce2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:33.576334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:33.578254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 131/263] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:33 2022] GET /identity/v3/users/ec6b460fb3394ce79a47ae75846c2ce2 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:33.585818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:33.650489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:33.733866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b56f1cb-5e17-4d70-9bc9-1321d80f790f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:33.784567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9f2a7-1263-4a40-ae84-e5b46949ca82 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:33.841161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:33.841798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:33.842084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:33.842402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:33.844539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:33.859350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:33.860009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:33.860286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:33.860561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:33.985241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:33.986655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:34.002736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:34.004267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:34.151974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:34.162432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 132/264] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:34.174206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:34.196043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 133/265] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:34.200993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:34.243490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:34.351707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38b456-e924-4138-adb4-061dace0d9b9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:34.392121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:34.392768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.393047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.393320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.395203 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:34.396690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:34.398358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 134/266] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:34 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:34.410322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:34.431658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b235437-3e8b-4e09-9ddf-7e84c783c911 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:34.467571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:34.500919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da883d-5e9f-4460-a6b4-b8dadd9a746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:34.501478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da883d-5e9f-4460-a6b4-b8dadd9a746e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.501754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da883d-5e9f-4460-a6b4-b8dadd9a746e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.502027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da883d-5e9f-4460-a6b4-b8dadd9a746e None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.508233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da883d-5e9f-4460-a6b4-b8dadd9a746e None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:34.509787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da883d-5e9f-4460-a6b4-b8dadd9a746e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:34.511694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 133/267] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:34 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:34.512829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da845bf7-a93a-429e-a197-97f000f7974d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.513105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da845bf7-a93a-429e-a197-97f000f7974d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.513371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da845bf7-a93a-429e-a197-97f000f7974d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.515014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 134/268] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:34.518254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da845bf7-a93a-429e-a197-97f000f7974d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:34.532063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2e443-9170-4f65-aa16-de477900062c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:34.567595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddeaf9-2457-418f-8c19-f74abb72876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:34.568480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddeaf9-2457-418f-8c19-f74abb72876e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.568931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddeaf9-2457-418f-8c19-f74abb72876e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.569346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddeaf9-2457-418f-8c19-f74abb72876e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.570234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddeaf9-2457-418f-8c19-f74abb72876e None admin] RBAC: Adding query filter params (role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=ec6b460fb3394ce79a47ae75846c2ce2) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:34.570689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddeaf9-2457-418f-8c19-f74abb72876e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:34.572390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddeaf9-2457-418f-8c19-f74abb72876e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:34.583916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 135/269] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:34 2022] GET /identity/v3/role_assignments?user.id=ec6b460fb3394ce79a47ae75846c2ce2&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=849d3aaa045348b78fb1017e4080b01c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:34.585697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a511cdf-1025-4525-8400-7a6eba34706a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.586129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a511cdf-1025-4525-8400-7a6eba34706a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.586576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a511cdf-1025-4525-8400-7a6eba34706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.620702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9a511cdf-1025-4525-8400-7a6eba34706a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:34.622217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9a511cdf-1025-4525-8400-7a6eba34706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:34.721427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 136/270] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:34.727134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56a87-7a42-4067-a031-b33adee10a1c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.727675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56a87-7a42-4067-a031-b33adee10a1c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.728099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b56a87-7a42-4067-a031-b33adee10a1c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.730170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 137/271] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:34.735869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5d35-b699-4f72-b463-95c8335df0fb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.736150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5d35-b699-4f72-b463-95c8335df0fb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.736427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f5d35-b699-4f72-b463-95c8335df0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.756999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-262f5d35-b699-4f72-b463-95c8335df0fb None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:34.758130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-262f5d35-b699-4f72-b463-95c8335df0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:34.765804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:34.788334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da845bf7-a93a-429e-a197-97f000f7974d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:34.794230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:34.862577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:34.863211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:34.863482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:34.863777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:34.864517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=ec6b460fb3394ce79a47ae75846c2ce2) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:34.864818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:34.866290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:34.885510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 138/273] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:34.885704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 135/273] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:34 2022] GET /identity/v3/role_assignments?user.id=ec6b460fb3394ce79a47ae75846c2ce2&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:35.168795 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f5d35-b699-4f72-b463-95c8335df0fb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:35.180749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:35.309443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f5d35-b699-4f72-b463-95c8335df0fb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:35.323657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625d31b-fae1-44a8-89eb-f802b17d2776 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:35.355662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:35.356872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.357162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.357721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.360303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:35.361784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:35.363605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 139/274] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:35.368972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:35.371196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:35.371939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.372218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.372490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.384352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:35.390376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:35.391271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:35.392190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 136/275] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:35.404907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:35.408011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:35.441155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:35.511587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bd3bb-0c9a-486b-9871-2db918fd5aa6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:35.553068 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99208e-0b2a-4c7d-8ba1-34d9ce76bdf7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:35.555194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d01e-091d-44ca-8701-a10998500b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:35.556905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d01e-091d-44ca-8701-a10998500b17 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.557377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d01e-091d-44ca-8701-a10998500b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.557812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d01e-091d-44ca-8701-a10998500b17 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.558656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1d01e-091d-44ca-8701-a10998500b17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:35.561082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1d01e-091d-44ca-8701-a10998500b17 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:35.593598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 140/276] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:15:35 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:15:35.598144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:35.598845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.599129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.599400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.600140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:35.600450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:35.601878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:35.618794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 137/277] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:35.621857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71935-d487-48de-973f-eb4f83ef8349 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.622485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71935-d487-48de-973f-eb4f83ef8349 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.622948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71935-d487-48de-973f-eb4f83ef8349 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.625305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 141/278] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:35.628941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:35.631140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ed86-5ad9-49e1-8e02-fd1f0e0e59d4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.631735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ed86-5ad9-49e1-8e02-fd1f0e0e59d4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.632269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ed86-5ad9-49e1-8e02-fd1f0e0e59d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.653015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4080ed86-5ad9-49e1-8e02-fd1f0e0e59d4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:35.654926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4080ed86-5ad9-49e1-8e02-fd1f0e0e59d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:35.736766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:35.758820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c3ae7-8031-456c-8c92-884610e091ec None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:35.765091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 142/279] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:35.800336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffcff4-b8ea-4ebb-8e17-23a7d036be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:35.801390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffcff4-b8ea-4ebb-8e17-23a7d036be01 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.801903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffcff4-b8ea-4ebb-8e17-23a7d036be01 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.802389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffcff4-b8ea-4ebb-8e17-23a7d036be01 None admin] PATH_INFO: `/v3/users/660d1a59a15648cea36415cb6799836d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.817628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffcff4-b8ea-4ebb-8e17-23a7d036be01 None admin] RBAC: Authorizing `identity:get_user(user_id=660d1a59a15648cea36415cb6799836d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:35.819499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cffcff4-b8ea-4ebb-8e17-23a7d036be01 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:35.821677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 138/280] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:35 2022] GET /identity/v3/users/660d1a59a15648cea36415cb6799836d => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:35.828417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ed86-5ad9-49e1-8e02-fd1f0e0e59d4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:35.849691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4caa-3749-4732-9136-186061c85145 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.849978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4caa-3749-4732-9136-186061c85145 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.850256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc4caa-3749-4732-9136-186061c85145 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.852390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 139/281] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:35.853805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:35.858749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5464e-a05a-4e3b-81b4-86dd10b79c7e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.858749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5464e-a05a-4e3b-81b4-86dd10b79c7e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.858957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5464e-a05a-4e3b-81b4-86dd10b79c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.878606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-afa5464e-a05a-4e3b-81b4-86dd10b79c7e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:35.879894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-afa5464e-a05a-4e3b-81b4-86dd10b79c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:35.959078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ed86-5ad9-49e1-8e02-fd1f0e0e59d4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:35.961581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 140/282] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:35.996923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:35.997466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:35.997745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:35.998014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:35.998848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, user.id=660d1a59a15648cea36415cb6799836d, scope.system=all) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:35.999155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:36.000761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:36.006426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 143/283] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 05:15:35 2022] GET /identity/v3/role_assignments?user.id=660d1a59a15648cea36415cb6799836d&scope.system=all&role.id=834907900e824380a50e9ef4e00765c7 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:36.040192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5464e-a05a-4e3b-81b4-86dd10b79c7e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.122490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:36.156257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5464e-a05a-4e3b-81b4-86dd10b79c7e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:36.202354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:36.203019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:36.203306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:36.203620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:36.220472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:36.225624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:36.226493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:36.227280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:36.229831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 141/284] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:36.235944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.236090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.340102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:36.359702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5a0e4-a992-4f59-aeed-3fcadf79f6c0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:36.363814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4f65d-8d3f-4619-b127-35bf87e1a47f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:36.403317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:36.404967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:36.405469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:36.405927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:36.417914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:36.423184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:36.424089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:36.424889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:36.428528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 144/285] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:36.436954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.443436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:36.448189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:36.448810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:36.449499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:36.449781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:36.450514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:36.454874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:36.456371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:36.471685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 142/286] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:36.477319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.587571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee5428-35c4-4dd2-8f7f-7647ad4b0021 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:36.624087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:36.625197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:36.625680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:36.626157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:36.627091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:36.627674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:36.629177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:36.630661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b73fb-f374-4a40-a64d-58de19cd6da3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:36.639024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 145/287] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:36.645606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.667910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:36.728867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:36.729530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:36.729810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:36.730107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] PATH_INFO: `/v3/users/8dc8dac3096f4983b6f0b2c7a3ada02d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:36.736330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] RBAC: Authorizing `identity:get_user(user_id=8dc8dac3096f4983b6f0b2c7a3ada02d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:36.737862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:36.739826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 143/288] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/users/8dc8dac3096f4983b6f0b2c7a3ada02d => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:36.745261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.757008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01f03e-e48c-4c70-a144-b4b3ef721aa1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:36.793458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:36.794343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:36.794780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:36.795181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] PATH_INFO: `/v3/users/81b0041497a64a3f81795b2089c240b6` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:36.796718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] RBAC: Authorizing `identity:get_user(user_id=81b0041497a64a3f81795b2089c240b6)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:36.798305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:36.800576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 146/289] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/users/81b0041497a64a3f81795b2089c240b6 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:36.812598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:36.852124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:36.895907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9120c1-cdd3-4ecf-abca-0cb85fbcf833 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:36.934082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:36.934995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:36.935430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:36.935950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:36.937453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:36.939663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:36.942974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:36.950780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 144/290] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:36.956493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:37.002042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb2503-10f9-42bd-9e3a-3da99ccc8a9c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:37.069032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:37.069941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:37.072616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:37.073068 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:37.162317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21836f-a2a7-4802-ae44-19208fcaa2ae None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:37.210278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:37.212591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:37.216911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:37.230501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:37.231411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:37.231851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:37.232264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/8dc8dac3096f4983b6f0b2c7a3ada02d/roles/b4f605c631114f63a32ac92acc3c5677` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:37.236662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=65df074f839b49e3a0dbada68f63cc52, user_id=8dc8dac3096f4983b6f0b2c7a3ada02d, role_id=b4f605c631114f63a32ac92acc3c5677)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:37.240807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:37.271591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 145/291] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:15:36 2022] PUT /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52/users/8dc8dac3096f4983b6f0b2c7a3ada02d/roles/b4f605c631114f63a32ac92acc3c5677 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:15:37.317191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:37.352511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 147/292] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:37.358288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:37.498369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875822b1-098f-4353-8ebf-9f7fb3017b96 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:37.536996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a0138-328e-4471-a3a5-c7ae809af02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:37.537711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0138-328e-4471-a3a5-c7ae809af02d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:37.538050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0138-328e-4471-a3a5-c7ae809af02d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:37.538328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a0138-328e-4471-a3a5-c7ae809af02d None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:37.539470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a0138-328e-4471-a3a5-c7ae809af02d None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:37.541108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a0138-328e-4471-a3a5-c7ae809af02d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:37.543101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 146/293] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:37 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:37.549520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:37.656247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38db3-a784-4d27-ac28-fae43c1d1392 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:37.691212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b4370-a97e-4249-9765-24b54abc6cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:37.691856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4370-a97e-4249-9765-24b54abc6cab None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:37.692138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4370-a97e-4249-9765-24b54abc6cab None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:37.692411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b4370-a97e-4249-9765-24b54abc6cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:37.693140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b4370-a97e-4249-9765-24b54abc6cab None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=81b0041497a64a3f81795b2089c240b6) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:37.693454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b4370-a97e-4249-9765-24b54abc6cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:37.694953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b4370-a97e-4249-9765-24b54abc6cab None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:37.701147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 148/294] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:37 2022] GET /identity/v3/role_assignments?user.id=81b0041497a64a3f81795b2089c240b6&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=834907900e824380a50e9ef4e00765c7 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:38.405678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff64d-e0da-4b79-b1a9-aa583dea318f None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:38.406098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff64d-e0da-4b79-b1a9-aa583dea318f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:38.406271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff64d-e0da-4b79-b1a9-aa583dea318f None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:38.408118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 147/295] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:38.413840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3cbf3-4bf6-41cd-8618-9392f97ac457 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:38.414147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3cbf3-4bf6-41cd-8618-9392f97ac457 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:38.414403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3cbf3-4bf6-41cd-8618-9392f97ac457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:38.433750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-61b3cbf3-4bf6-41cd-8618-9392f97ac457 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:38.435003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-61b3cbf3-4bf6-41cd-8618-9392f97ac457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:38.470952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:38.513667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 149/296] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:38.571592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d42d-680a-4185-ab68-1bce6fa6b147 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:38.572526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d42d-680a-4185-ab68-1bce6fa6b147 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:38.572833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f6df-6127-4ab2-8f54-8114c9307ce9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:38.573120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f6df-6127-4ab2-8f54-8114c9307ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:38.573393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f6df-6127-4ab2-8f54-8114c9307ce9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:38.573636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5d42d-680a-4185-ab68-1bce6fa6b147 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:38.574988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 150/297] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:38.575695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 148/298] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:38.579886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520ee1-cb20-4530-ab1b-73e5ba436889 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:38.580168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520ee1-cb20-4530-ab1b-73e5ba436889 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:38.580441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e520ee1-cb20-4530-ab1b-73e5ba436889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:38.581682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b180285-a7a4-46d2-8348-b2b914ccc127 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:38.582164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b180285-a7a4-46d2-8348-b2b914ccc127 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:38.582629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b180285-a7a4-46d2-8348-b2b914ccc127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:38.599250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2e520ee1-cb20-4530-ab1b-73e5ba436889 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:38.600461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2e520ee1-cb20-4530-ab1b-73e5ba436889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:38.605174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2b180285-a7a4-46d2-8348-b2b914ccc127 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:38.606639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2b180285-a7a4-46d2-8348-b2b914ccc127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:38.674988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:38.679684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 151/299] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:38.697060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 149/300] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:38.778170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520ee1-cb20-4530-ab1b-73e5ba436889 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:38.875304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:38.883221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e520ee1-cb20-4530-ab1b-73e5ba436889 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:38.918409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:38.919376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:38.919873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:38.920531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:38.921845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:38.923482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:38.925590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 152/301] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:38.933271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b180285-a7a4-46d2-8348-b2b914ccc127 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:38.958727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.036795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b180285-a7a4-46d2-8348-b2b914ccc127 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.069157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530a3c6-0164-40ce-9cab-f44c24638118 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.071890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.072499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.072774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.073043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] PATH_INFO: `/v3/groups` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.073685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:39.075135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:39.099584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 150/302] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Sep 26 05:15:38 2022] POST /identity/v3/groups => generated 229 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:15:39.099584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.112770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.113548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.113899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.114239 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.127110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:39.132167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:39.133141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:39.133940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 153/303] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:39.140666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.165757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:39.172051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:39.234651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eed2a-7a5f-4fe3-9c02-3013938d067a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.265249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625436c4-ce63-4874-bcb0-1556d369db3f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.276134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.277194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.277693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.278229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.299331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:39.305002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:39.305157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:39.310941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:39.311972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:39.312592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.312592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.312592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.312771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 151/304] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:39.312842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:39.312842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:39.312842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:39.314247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.319306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 154/305] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:39.324494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.420133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:39.439248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96544d4-597a-4dee-8022-f85b71bafe68 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.451094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1904bf2-a68d-4fff-90fd-e6be438e05b7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.463560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:39.477527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.478173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.478454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.478738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] PATH_INFO: `/v3/users/db6a48ba74d74e14bc49571638efb44f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.495932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] RBAC: Authorizing `identity:get_user(user_id=db6a48ba74d74e14bc49571638efb44f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:39.497414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:39.504417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 155/306] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:39 2022] GET /identity/v3/users/db6a48ba74d74e14bc49571638efb44f => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:39.506678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.507663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.508296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.508576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.508847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.509527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:39.509828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:39.511218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:39.523581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 152/307] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:39.528550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.632667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deec24-e040-42a5-988d-88af50ed243b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.666960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9862a-b3cc-4be3-82ce-6164f20aaac7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.682546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.683966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.684382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.685022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.686563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] RBAC: Adding query filter params (role.id=b4f605c631114f63a32ac92acc3c5677, user.id=db6a48ba74d74e14bc49571638efb44f, scope.system=all) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:39.687031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:39.688968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:39.703791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 156/308] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 05:15:39 2022] GET /identity/v3/role_assignments?user.id=db6a48ba74d74e14bc49571638efb44f&scope.system=all&role.id=b4f605c631114f63a32ac92acc3c5677 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:39.712031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422737b8-a4c7-4466-afe7-d7d47735f2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.712943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422737b8-a4c7-4466-afe7-d7d47735f2cb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.713405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422737b8-a4c7-4466-afe7-d7d47735f2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.713852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422737b8-a4c7-4466-afe7-d7d47735f2cb None admin] PATH_INFO: `/v3/users/660d1a59a15648cea36415cb6799836d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.715879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422737b8-a4c7-4466-afe7-d7d47735f2cb None admin] RBAC: Authorizing `identity:get_user(user_id=660d1a59a15648cea36415cb6799836d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:39.717452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422737b8-a4c7-4466-afe7-d7d47735f2cb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:39.719947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 153/309] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:39 2022] GET /identity/v3/users/660d1a59a15648cea36415cb6799836d => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:39.725562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:39.740075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:39.753454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60b142-35e3-4e77-b77b-474c8e3e33cd None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.753782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60b142-35e3-4e77-b77b-474c8e3e33cd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.754000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60b142-35e3-4e77-b77b-474c8e3e33cd None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.755583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 154/310] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:39.761431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee69b8-1216-4a01-80b2-7352cc814a1d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.761700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee69b8-1216-4a01-80b2-7352cc814a1d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.761976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee69b8-1216-4a01-80b2-7352cc814a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.783369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e9ee69b8-1216-4a01-80b2-7352cc814a1d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:39.784731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e9ee69b8-1216-4a01-80b2-7352cc814a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:39.824025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:39.861724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7b5ec-2f3e-4610-8def-e31df6271913 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:39.891577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 155/311] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:39.912095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:39.912759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:39.913209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:39.913478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] PATH_INFO: `/v3/system/users/660d1a59a15648cea36415cb6799836d/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:39.914905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=660d1a59a15648cea36415cb6799836d, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:39.916364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:39.927273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 157/312] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Sep 26 05:15:39 2022] PUT /identity/v3/system/users/660d1a59a15648cea36415cb6799836d/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:15:40.154220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee69b8-1216-4a01-80b2-7352cc814a1d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:40.259126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee69b8-1216-4a01-80b2-7352cc814a1d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:40.303934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85e22-32c9-400b-a027-999600716daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:40.304985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85e22-32c9-400b-a027-999600716daf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:40.305469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85e22-32c9-400b-a027-999600716daf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:40.305926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85e22-32c9-400b-a027-999600716daf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:40.318134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec85e22-32c9-400b-a027-999600716daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-bec85e22-32c9-400b-a027-999600716daf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:40.323190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:40.324106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:40.324923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:40.327200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 156/313] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:40.335995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:40.401673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:40.435094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298e013-7f76-4afd-98ee-dd2dd741a5a8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:40.469824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:40.470740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:40.471207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:40.471674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:40.472500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:40.472969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:40.474503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:40.483721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 158/314] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:40.492685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85e22-32c9-400b-a027-999600716daf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:40.522435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:40.598829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85e22-32c9-400b-a027-999600716daf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:40.632960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:40.633595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:40.633868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:40.634139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] PATH_INFO: `/v3/users/8dc8dac3096f4983b6f0b2c7a3ada02d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:40.635250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] RBAC: Authorizing `identity:get_user(user_id=8dc8dac3096f4983b6f0b2c7a3ada02d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:40.636786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:40.643104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 157/315] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:40 2022] GET /identity/v3/users/8dc8dac3096f4983b6f0b2c7a3ada02d => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:40.644521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:40.746939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a45294-5d24-4164-ab55-c7f8e82eb9ff None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:40.780431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:40.785411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:40.786035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:40.786317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:40.786590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:40.859587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:40.861088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:40.966933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 159/316] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:40.972584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:41.068512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:41.074670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56a5c3-7ccf-4813-8a56-1d9a35dbc6fc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:41.110672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefbe30-79c5-45ae-881a-fa021d607797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:41.111306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbe30-79c5-45ae-881a-fa021d607797 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:41.111604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbe30-79c5-45ae-881a-fa021d607797 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:41.111873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefbe30-79c5-45ae-881a-fa021d607797 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:41.112983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefbe30-79c5-45ae-881a-fa021d607797 None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:41.114441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefbe30-79c5-45ae-881a-fa021d607797 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:41.121117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 158/317] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:40 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:41.122597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:41.154925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:41.225264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f612a-68c1-4dfe-bbf3-4307096d20c3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:41.259294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc115-38b8-4d7b-b307-5fdbaa21aa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:41.259943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc115-38b8-4d7b-b307-5fdbaa21aa23 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:41.260224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc115-38b8-4d7b-b307-5fdbaa21aa23 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:41.260502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc115-38b8-4d7b-b307-5fdbaa21aa23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:41.261234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc115-38b8-4d7b-b307-5fdbaa21aa23 None admin] RBAC: Adding query filter params (role.id=b4f605c631114f63a32ac92acc3c5677, scope.project.id=65df074f839b49e3a0dbada68f63cc52, user.id=8dc8dac3096f4983b6f0b2c7a3ada02d) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:41.261545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc115-38b8-4d7b-b307-5fdbaa21aa23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:41.262992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc115-38b8-4d7b-b307-5fdbaa21aa23 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:41.269492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 160/318] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:15:41 2022] GET /identity/v3/role_assignments?user.id=8dc8dac3096f4983b6f0b2c7a3ada02d&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=b4f605c631114f63a32ac92acc3c5677 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:41.425502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c15cf-bba3-4913-b3a8-f7774e20eafe None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:41.426151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c15cf-bba3-4913-b3a8-f7774e20eafe None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:41.426621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c15cf-bba3-4913-b3a8-f7774e20eafe None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:41.428623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 159/319] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:41.438616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ca84c-8bc6-4980-83c9-420b092b8071 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:41.439253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ca84c-8bc6-4980-83c9-420b092b8071 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:41.439769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143ca84c-8bc6-4980-83c9-420b092b8071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:41.461757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-143ca84c-8bc6-4980-83c9-420b092b8071 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:41.462760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-143ca84c-8bc6-4980-83c9-420b092b8071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:41.533368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 161/320] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:41.804306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c15cf-bba3-4913-b3a8-f7774e20eafe None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:41.913698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c15cf-bba3-4913-b3a8-f7774e20eafe None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:41.952183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdc653-b916-483b-bd03-99178928a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:41.952850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdc653-b916-483b-bd03-99178928a752 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:41.953130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdc653-b916-483b-bd03-99178928a752 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:41.953402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdc653-b916-483b-bd03-99178928a752 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:41.954601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdc653-b916-483b-bd03-99178928a752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:41.956196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdc653-b916-483b-bd03-99178928a752 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:41.957985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 160/321] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:41.963820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ca84c-8bc6-4980-83c9-420b092b8071 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:41.991024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:42.048637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e239-3756-49b0-9591-c2f96ba32794 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.049183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e239-3756-49b0-9591-c2f96ba32794 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.049183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e239-3756-49b0-9591-c2f96ba32794 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.050827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 161/322] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:42.056691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdfbf6-708f-46ba-bd12-56931ca11d0d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.056860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdfbf6-708f-46ba-bd12-56931ca11d0d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.057163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdfbf6-708f-46ba-bd12-56931ca11d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.071238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143ca84c-8bc6-4980-83c9-420b092b8071 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:42.075868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-30cdfbf6-708f-46ba-bd12-56931ca11d0d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:42.077148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-30cdfbf6-708f-46ba-bd12-56931ca11d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:42.103922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:42.106073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812016c-89f2-47b6-8e53-fe33378fbb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:42.106696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812016c-89f2-47b6-8e53-fe33378fbb04 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.106976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812016c-89f2-47b6-8e53-fe33378fbb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.107252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812016c-89f2-47b6-8e53-fe33378fbb04 None admin] PATH_INFO: `/v3/groups` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.108028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812016c-89f2-47b6-8e53-fe33378fbb04 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:42.109608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812016c-89f2-47b6-8e53-fe33378fbb04 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:42.128834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 162/323] 10.222.0.18 () {60 vars in 1134 bytes} [Mon Sep 26 05:15:41 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:15:42.153463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 162/324] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:42.155749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbecd-13a3-4b37-8c0a-e51d2e22f93b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.156044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbecd-13a3-4b37-8c0a-e51d2e22f93b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.156307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbecd-13a3-4b37-8c0a-e51d2e22f93b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.157919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 163/325] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:42.164180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7a8d-2d6c-4552-b598-a9062924525b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.164769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7a8d-2d6c-4552-b598-a9062924525b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.165218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca7a8d-2d6c-4552-b598-a9062924525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.185482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a4ca7a8d-2d6c-4552-b598-a9062924525b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:42.187445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a4ca7a8d-2d6c-4552-b598-a9062924525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:42.262839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 163/326] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:42.421550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dbecd-13a3-4b37-8c0a-e51d2e22f93b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:42.514654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:42.531228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7a8d-2d6c-4552-b598-a9062924525b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:42.533848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dbecd-13a3-4b37-8c0a-e51d2e22f93b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:42.580697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:42.581657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.581980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.582212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.593922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:42.598714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:42.599650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:42.600476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 164/327] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:42.606401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:42.666083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:42.677221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca7a8d-2d6c-4552-b598-a9062924525b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:42.723606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:42.724091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.724366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.725371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.741336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:42.743107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42afb5-ed0d-4f35-a205-4ded65e30ead None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:42.746632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:42.748425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:42.749537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 164/328] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:42.754917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:42.796767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:42.797662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.798096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.798370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.799044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:42.799348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:42.802398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:42.813044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 165/329] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:42.818831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:42.831637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:42.891514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ed6ad-0065-4e09-88ba-12caf033b5c5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:42.938961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:42.940338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.940894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.941341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.942212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:42.942364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc38aa-7f74-450c-9b6d-5ca32b75588d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:42.942832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:42.944683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:42.956919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 165/330] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:42.962557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:42.985087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:42.987601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:42.987601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:42.987601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:42.987601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] PATH_INFO: `/v3/users/db6a48ba74d74e14bc49571638efb44f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:42.989365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] RBAC: Authorizing `identity:get_user(user_id=db6a48ba74d74e14bc49571638efb44f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:42.992147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:42.995384 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 166/331] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:42 2022] GET /identity/v3/users/db6a48ba74d74e14bc49571638efb44f => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:43.001255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:43.101542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:43.105321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c2ad0-2415-49f1-82a5-266a553f2cc1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:43.130919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb64cd-0ad3-4131-9bc8-7df0ec3557a7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:43.150264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:43.151209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:43.151997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:43.152826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] PATH_INFO: `/v3/users/660d1a59a15648cea36415cb6799836d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:43.154139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] RBAC: Authorizing `identity:get_user(user_id=660d1a59a15648cea36415cb6799836d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:43.156537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:43.159036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 166/332] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:42 2022] GET /identity/v3/users/660d1a59a15648cea36415cb6799836d => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:43.164685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:43.173107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd315ef-4b38-4131-a9eb-91abd5676bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:43.173917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd315ef-4b38-4131-a9eb-91abd5676bc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:43.174264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd315ef-4b38-4131-a9eb-91abd5676bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:43.174630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd315ef-4b38-4131-a9eb-91abd5676bc1 None admin] PATH_INFO: `/v3/system/users/db6a48ba74d74e14bc49571638efb44f/roles/b4f605c631114f63a32ac92acc3c5677` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:43.176240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd315ef-4b38-4131-a9eb-91abd5676bc1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=db6a48ba74d74e14bc49571638efb44f, role_id=b4f605c631114f63a32ac92acc3c5677)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:43.177778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd315ef-4b38-4131-a9eb-91abd5676bc1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:43.198922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 167/333] 10.222.0.18 () {58 vars in 1334 bytes} [Mon Sep 26 05:15:43 2022] PUT /identity/v3/system/users/db6a48ba74d74e14bc49571638efb44f/roles/b4f605c631114f63a32ac92acc3c5677 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:43.267753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:43.305190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ad485-7023-4d40-b983-cbcef0096121 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:43.348390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf3180-6eff-4d03-b58f-4b04dbaf7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:43.349024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf3180-6eff-4d03-b58f-4b04dbaf7162 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:43.349297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf3180-6eff-4d03-b58f-4b04dbaf7162 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:43.349649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf3180-6eff-4d03-b58f-4b04dbaf7162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:43.350387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf3180-6eff-4d03-b58f-4b04dbaf7162 None admin] RBAC: Adding query filter params (role.id=834907900e824380a50e9ef4e00765c7, user.id=660d1a59a15648cea36415cb6799836d, scope.system=all) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:43.350698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf3180-6eff-4d03-b58f-4b04dbaf7162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:43.352290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf3180-6eff-4d03-b58f-4b04dbaf7162 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:43.366254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 05:15:43 2022] GET /identity/v3/role_assignments?user.id=660d1a59a15648cea36415cb6799836d&scope.system=all&role.id=834907900e824380a50e9ef4e00765c7 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:45.057089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d0939-e562-4c3b-a8c7-7ec5b6b75d33 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:45.057615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d0939-e562-4c3b-a8c7-7ec5b6b75d33 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:45.057615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d0939-e562-4c3b-a8c7-7ec5b6b75d33 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:45.058990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 168/335] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:45.072991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58143b5-aace-4505-92f1-fcd3d8e1b3b6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:45.073473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58143b5-aace-4505-92f1-fcd3d8e1b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:45.073546 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58143b5-aace-4505-92f1-fcd3d8e1b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:45.097390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f58143b5-aace-4505-92f1-fcd3d8e1b3b6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:45.098601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f58143b5-aace-4505-92f1-fcd3d8e1b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:45.128988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599f0b-a75e-4409-a0ef-26a26fb7b128 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:45.129304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599f0b-a75e-4409-a0ef-26a26fb7b128 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:45.129531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2599f0b-a75e-4409-a0ef-26a26fb7b128 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:45.131705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 169/336] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:45.136633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f1ca-221d-411b-b949-0931422af324 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:45.136908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f1ca-221d-411b-b949-0931422af324 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:45.137174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f1ca-221d-411b-b949-0931422af324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:45.165988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3b11f1ca-221d-411b-b949-0931422af324 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:45.167186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3b11f1ca-221d-411b-b949-0931422af324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:45.220890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 168/337] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:45.269775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 170/338] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:45.627538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58143b5-aace-4505-92f1-fcd3d8e1b3b6 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:45.656565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11f1ca-221d-411b-b949-0931422af324 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:45.723923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:45.786633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:45.791535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58143b5-aace-4505-92f1-fcd3d8e1b3b6 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:45.860221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:45.861521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:45.862015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:45.862481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:45.877675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11f1ca-221d-411b-b949-0931422af324 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:45.882509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:45.889728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:45.890854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:45.892337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:45.895257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 169/339] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:45.900677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:45.996522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92051bb-5622-4f4a-ab89-fa956deb4095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:45.997177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92051bb-5622-4f4a-ab89-fa956deb4095 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:45.997460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92051bb-5622-4f4a-ab89-fa956deb4095 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:45.997730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92051bb-5622-4f4a-ab89-fa956deb4095 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.024385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92051bb-5622-4f4a-ab89-fa956deb4095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b92051bb-5622-4f4a-ab89-fa956deb4095 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:46.030889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:46.031794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:46.032563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:46.039571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 171/340] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:46.039571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91d2c-b903-4f65-9d8c-4096fdb5d837 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.039571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91d2c-b903-4f65-9d8c-4096fdb5d837 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.039571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91d2c-b903-4f65-9d8c-4096fdb5d837 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.040630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 172/341] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:46.043826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91d2c-b903-4f65-9d8c-4096fdb5d837 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:46.059835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde3f83-d891-4e8c-9eda-56f2fe2c78ac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:46.124304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:46.132084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767f136-4a03-4323-a208-057962dc6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:46.132639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f136-4a03-4323-a208-057962dc6376 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.132920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f136-4a03-4323-a208-057962dc6376 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.133237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767f136-4a03-4323-a208-057962dc6376 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.133912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767f136-4a03-4323-a208-057962dc6376 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:46.134225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767f136-4a03-4323-a208-057962dc6376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:46.135674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767f136-4a03-4323-a208-057962dc6376 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:46.148025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 170/342] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:46.149536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090ee8-a419-4146-8f9e-c7bac360e5e5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.149915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090ee8-a419-4146-8f9e-c7bac360e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.150288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08090ee8-a419-4146-8f9e-c7bac360e5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.171821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-08090ee8-a419-4146-8f9e-c7bac360e5e5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:46.173171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-08090ee8-a419-4146-8f9e-c7bac360e5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:46.199437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91d2c-b903-4f65-9d8c-4096fdb5d837 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:46.240281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:46.252639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:46.252639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.252915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.253256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.254338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:46.254745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:46.258423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:46.266464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 171/343] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:46.267918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08090ee8-a419-4146-8f9e-c7bac360e5e5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:46.269619 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 173/344] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:46.276130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:46.460963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e53ce-02d0-4d17-a518-1edd0e21ded0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:46.461698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08090ee8-a419-4146-8f9e-c7bac360e5e5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:46.500060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59362db8-bee6-4d67-80f9-62ae25f517ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:46.500981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362db8-bee6-4d67-80f9-62ae25f517ac None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.501426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362db8-bee6-4d67-80f9-62ae25f517ac None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.501860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59362db8-bee6-4d67-80f9-62ae25f517ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.514506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:46.545239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:46.545876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.546155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.546429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.571080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:46.578506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362db8-bee6-4d67-80f9-62ae25f517ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:46.580048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59362db8-bee6-4d67-80f9-62ae25f517ac None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:46.670557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:46.672708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:46.710137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 174/345] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:46.711473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f49c3-9d12-4b43-868c-3323ba9edbbd None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.715833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f49c3-9d12-4b43-868c-3323ba9edbbd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.716416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f49c3-9d12-4b43-868c-3323ba9edbbd None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.721153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 175/346] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:46.721729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f49c3-9d12-4b43-868c-3323ba9edbbd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:46.807598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 172/347] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:46.808880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:46.840655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:46.845235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:46.857659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f49c3-9d12-4b43-868c-3323ba9edbbd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:46.897706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb829af4-03cb-400d-85e9-d97776b8a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:46.898344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829af4-03cb-400d-85e9-d97776b8a0ee None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.898621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829af4-03cb-400d-85e9-d97776b8a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.898927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb829af4-03cb-400d-85e9-d97776b8a0ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.912133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb829af4-03cb-400d-85e9-d97776b8a0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-cb829af4-03cb-400d-85e9-d97776b8a0ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:46.916922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:46.917969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:46.918793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 176/348] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:46.919489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572bf6-ccae-4cc7-bc55-96645ef5aab8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.926372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572bf6-ccae-4cc7-bc55-96645ef5aab8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.926372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572bf6-ccae-4cc7-bc55-96645ef5aab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.943740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-61572bf6-ccae-4cc7-bc55-96645ef5aab8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:46.944942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299606f1-e266-4bd8-8e41-4a6be5754262 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:46.945506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-61572bf6-ccae-4cc7-bc55-96645ef5aab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:46.990251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:46.991235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:46.991767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:46.992241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:46.993581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:46.995261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:46.997362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 173/349] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:46 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:46.998278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.037585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 177/350] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:47.038780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572bf6-ccae-4cc7-bc55-96645ef5aab8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.125025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:47.132460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bde64-cb5a-4560-b1b8-cdd033f55b20 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.142491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:47.164197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572bf6-ccae-4cc7-bc55-96645ef5aab8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.194348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31f562-4e9b-489f-a972-a0aa3147da0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.195288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31f562-4e9b-489f-a972-a0aa3147da0f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.196025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31f562-4e9b-489f-a972-a0aa3147da0f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.196313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31f562-4e9b-489f-a972-a0aa3147da0f None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.197741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31f562-4e9b-489f-a972-a0aa3147da0f None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:47.199926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31f562-4e9b-489f-a972-a0aa3147da0f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:47.202536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 174/351] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:46 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:47.203818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cdd13-7eb5-451b-b728-d004fd93ce5f None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.204202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cdd13-7eb5-451b-b728-d004fd93ce5f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.204480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cdd13-7eb5-451b-b728-d004fd93ce5f None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.204573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.205133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.205415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.205685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.205780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 175/352] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:47.206585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cdd13-7eb5-451b-b728-d004fd93ce5f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.206853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:47.207170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:47.212773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:47.223754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 178/353] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:47.224607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.341758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cdd13-7eb5-451b-b728-d004fd93ce5f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.352413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee593f1-8982-4bce-abfb-5c085adf0af5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.389418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d10f65-0ace-4ec0-9b80-48a81c20239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.390279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d10f65-0ace-4ec0-9b80-48a81c20239f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.390555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d10f65-0ace-4ec0-9b80-48a81c20239f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.390819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d10f65-0ace-4ec0-9b80-48a81c20239f None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.395016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.395706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.395979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.396243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.400668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d10f65-0ace-4ec0-9b80-48a81c20239f None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:47.403507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d10f65-0ace-4ec0-9b80-48a81c20239f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:47.404421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:47.406001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 176/354] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:47.406170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:47.406896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95eba-3eca-4a6b-bcf9-4eb1c4d10ef7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.407162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95eba-3eca-4a6b-bcf9-4eb1c4d10ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.407609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf95eba-3eca-4a6b-bcf9-4eb1c4d10ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.411703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 179/355] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:47.413143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.429610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:47.430930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-abf95eba-3eca-4a6b-bcf9-4eb1c4d10ef7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:47.432171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-abf95eba-3eca-4a6b-bcf9-4eb1c4d10ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:47.451303 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:47.525013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 177/356] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:47.525888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95eba-3eca-4a6b-bcf9-4eb1c4d10ef7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.557103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf80a1-b279-4e55-9bfd-0655ceb4e0cc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.599696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.600865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.601321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.601822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.663999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf95eba-3eca-4a6b-bcf9-4eb1c4d10ef7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.684466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:47.686628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:47.698432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:47.713470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.714558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.714860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.715130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.728178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:47.733173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:47.734101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 178/357] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:47.735197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.757263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:47.818446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 180/358] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:47.819226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.865278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8cb5-c9b7-46e6-b753-cf51445ecbce None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.908467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2487a-9303-451d-9279-ba129df4f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.909113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2487a-9303-451d-9279-ba129df4f904 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.911158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2487a-9303-451d-9279-ba129df4f904 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.911158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2487a-9303-451d-9279-ba129df4f904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.911158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2487a-9303-451d-9279-ba129df4f904 None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=161e8f5438d748f1af7b50998d9eda1f) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:47.911158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2487a-9303-451d-9279-ba129df4f904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:47.912935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2487a-9303-451d-9279-ba129df4f904 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:47.918155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 179/359] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=834907900e824380a50e9ef4e00765c7 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:47.919503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9a818-9b79-4fba-a9fa-e73e5f8dc8b2 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.919797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9a818-9b79-4fba-a9fa-e73e5f8dc8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.920233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9a818-9b79-4fba-a9fa-e73e5f8dc8b2 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.921822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 180/360] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:47.922477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9a818-9b79-4fba-a9fa-e73e5f8dc8b2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:47.933503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653869b-e1b2-4a66-b764-15f5c7ba39ec None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:47.946157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:47.982363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:47.983379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:47.983906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:47.984365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:47.985314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=161e8f5438d748f1af7b50998d9eda1f) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:47.985836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:47.987324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:47.993833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 181/361] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=849d3aaa045348b78fb1017e4080b01c => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:47.995015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:48.052374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:48.070121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9a818-9b79-4fba-a9fa-e73e5f8dc8b2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.112272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.112740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.113020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.113288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.113977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:48.114292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:48.118201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:48.129531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 181/362] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:48.131391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:48.148759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7a5e1-5f55-4f3c-b150-47ae3687ebaa None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.212695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61858b6-4aec-410f-9a98-0de1498a43dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.213318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61858b6-4aec-410f-9a98-0de1498a43dc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.213557 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61858b6-4aec-410f-9a98-0de1498a43dc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.213846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61858b6-4aec-410f-9a98-0de1498a43dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.226428 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61858b6-4aec-410f-9a98-0de1498a43dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a61858b6-4aec-410f-9a98-0de1498a43dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:48.232988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:48.234001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:48.235168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 182/363] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:48.236112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a6f9-d57b-4cb6-8e92-c86f90711338 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.236112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a6f9-d57b-4cb6-8e92-c86f90711338 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.236229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a6f9-d57b-4cb6-8e92-c86f90711338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.255347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e8b2a6f9-d57b-4cb6-8e92-c86f90711338 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:48.256594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e8b2a6f9-d57b-4cb6-8e92-c86f90711338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:48.266191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04767a10-72bd-452b-9f4e-16bc16be5573 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.286403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:48.323798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.324791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.325958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.326483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.327975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:48.329722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:48.331880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 182/364] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:48 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:48.332579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 183/365] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:48.333151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:48.333412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2a6f9-d57b-4cb6-8e92-c86f90711338 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:48.355614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:48.441105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2a6f9-d57b-4cb6-8e92-c86f90711338 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.476955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.477860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.478236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.478617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.482266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:48.482266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:48.482266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:48.490266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 184/366] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:48.491222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:48.519311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:48.530795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e8608-e40b-465e-b016-9023fe89f2eb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.609583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.610246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.610527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.610799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] PATH_INFO: `/v3/users/db6a48ba74d74e14bc49571638efb44f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.617136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] RBAC: Authorizing `identity:get_user(user_id=db6a48ba74d74e14bc49571638efb44f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:48.618615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:48.620434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 183/367] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:15:48 2022] GET /identity/v3/users/db6a48ba74d74e14bc49571638efb44f => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:48.621026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:48.673956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d399f-95d4-4ef8-8db6-c7c62c014007 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.750321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.750972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.751251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.752902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.754797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:48.756285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:48.758524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 185/368] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:48 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:48.759294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:48.776219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:48.818345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5815ae-ec93-4d6d-8b33-b961134e27d9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.857642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0987de-a835-43cc-b655-1346af059393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.858690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0987de-a835-43cc-b655-1346af059393 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.859164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0987de-a835-43cc-b655-1346af059393 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.859739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0987de-a835-43cc-b655-1346af059393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.890380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:48.900420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fbda0-28fe-4e67-aa8f-73247821fd32 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:48.941644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:48.942259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:48.942535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:48.942800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:48.943838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] RBAC: Adding query filter params (role.id=b4f605c631114f63a32ac92acc3c5677, user.id=db6a48ba74d74e14bc49571638efb44f, scope.system=all) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:48.944147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:48.946178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:48.947620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0987de-a835-43cc-b655-1346af059393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:48.949324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0987de-a835-43cc-b655-1346af059393 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:48.961008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 186/369] 10.222.0.18 () {56 vars in 1308 bytes} [Mon Sep 26 05:15:48 2022] GET /identity/v3/role_assignments?user.id=db6a48ba74d74e14bc49571638efb44f&scope.system=all&role.id=b4f605c631114f63a32ac92acc3c5677 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:48.962016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:49.061297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:49.100388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 184/370] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:49.100942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e86cb-b3d7-4f8b-a133-ecca77c5d1f9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:49.101299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0987de-a835-43cc-b655-1346af059393 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:49.141780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:49.143044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:49.143537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:49.144048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:49.145074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=65df074f839b49e3a0dbada68f63cc52) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:49.145626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:49.147277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:49.154238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 187/371] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:48 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=834907900e824380a50e9ef4e00765c7 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:49.155504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:49.192245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:49.294960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0987de-a835-43cc-b655-1346af059393 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:49.355424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:49.356654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:49.357157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:49.357766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:49.372761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:49.378770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:49.379774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:49.380689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:49.383228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 185/372] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:49.389735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:49.408008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cbc08-9992-4ad9-a11c-cdd61ac906a6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:49.439736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:49.459113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:49.461062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:49.461344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:49.461618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:49.462786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:49.464651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:49.466135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 188/373] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:49 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:49.472325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:49.527659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f319c-810a-4853-a724-b1b6233e9374 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:49.569740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:49.570372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:49.570653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:49.570928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:49.571629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:49.571938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:49.573336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:49.580088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:49.584902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 186/374] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:49.590627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:49.603421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511bbdc-4110-4e83-ad9c-cb1b55756c0c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:49.666184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:49.666761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:49.667039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:49.667359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:49.672120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:49.673622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:49.675302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 189/375] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:49 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:49.693404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:49.731983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:49.740665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb33cc-79ab-4baf-887d-674462833864 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:49.782974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:49.784101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:49.784598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:49.785061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:49.863165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:49.865024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:49.925830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115939c1-17b3-4030-acb7-f4c4e229a515 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:49.970027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 187/376] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 05:15:49.972015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:49.976550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:50.005892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:50.006881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.007356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.007978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.008928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=65df074f839b49e3a0dbada68f63cc52) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:50.009434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:50.011087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:50.019895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 190/377] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:49 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=849d3aaa045348b78fb1017e4080b01c => generated 260 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:50.155189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6056762-22f7-40ca-85f4-2aafc48c7288 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:50.203947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:50.204528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.204807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.205085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] PATH_INFO: `/v3/projects/2e12d4768420490681bee18f38969146` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.206269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=2e12d4768420490681bee18f38969146)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:50.207751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:50.209609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 188/378] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:49 2022] GET /identity/v3/projects/2e12d4768420490681bee18f38969146 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:50.215292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:50.242895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:50.367853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648be1f2-ecff-421a-a345-d5a1107b8218 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:50.411738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f499134-8d34-426a-83b1-95fef4905dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:50.413202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499134-8d34-426a-83b1-95fef4905dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.413677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499134-8d34-426a-83b1-95fef4905dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.414141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f499134-8d34-426a-83b1-95fef4905dd8 None admin] PATH_INFO: `/v3/groups/e33b014e5d37487393d21d57494f28ed` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.424008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f499134-8d34-426a-83b1-95fef4905dd8 None admin] RBAC: Authorizing `identity:get_group(group_id=e33b014e5d37487393d21d57494f28ed)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:50.425798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f499134-8d34-426a-83b1-95fef4905dd8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:50.428070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 191/379] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:50 2022] GET /identity/v3/groups/e33b014e5d37487393d21d57494f28ed => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:50.433976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:50.520086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:50.562621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253067a-252b-42e6-9e4d-7e6f2bb8f6d7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:50.600076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d04871-a385-4459-9816-0fd0d3fdb0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:50.600696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d04871-a385-4459-9816-0fd0d3fdb0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.600974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d04871-a385-4459-9816-0fd0d3fdb0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.601296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d04871-a385-4459-9816-0fd0d3fdb0a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.602035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d04871-a385-4459-9816-0fd0d3fdb0a0 None admin] RBAC: Adding query filter params (group.id=e33b014e5d37487393d21d57494f28ed, role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=2e12d4768420490681bee18f38969146) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:50.602342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d04871-a385-4459-9816-0fd0d3fdb0a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:50.603829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d04871-a385-4459-9816-0fd0d3fdb0a0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:50.610087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 189/380] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:50 2022] GET /identity/v3/role_assignments?group.id=e33b014e5d37487393d21d57494f28ed&scope.project.id=2e12d4768420490681bee18f38969146&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:50.669352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b80e-1eeb-49c1-b3ef-00441e8cfd01 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.669682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b80e-1eeb-49c1-b3ef-00441e8cfd01 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.669989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b80e-1eeb-49c1-b3ef-00441e8cfd01 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.672369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 192/381] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:50.677930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aa778-6f95-4f98-9223-16d8ecf7f86e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.678220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aa778-6f95-4f98-9223-16d8ecf7f86e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.678554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191aa778-6f95-4f98-9223-16d8ecf7f86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.704111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-191aa778-6f95-4f98-9223-16d8ecf7f86e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:50.705352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-191aa778-6f95-4f98-9223-16d8ecf7f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:50.806291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 190/382] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:50.907775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0bf3-9b1d-46fe-a56c-512cc369d210 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.908424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0bf3-9b1d-46fe-a56c-512cc369d210 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.908904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf0bf3-9b1d-46fe-a56c-512cc369d210 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.910659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 193/383] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:50.918617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e204-0b3e-4abd-87d9-769555c5d96f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:50.918903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e204-0b3e-4abd-87d9-769555c5d96f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:50.919178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e204-0b3e-4abd-87d9-769555c5d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:50.947111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ce33e204-0b3e-4abd-87d9-769555c5d96f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:50.948328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ce33e204-0b3e-4abd-87d9-769555c5d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:51.009833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:51.024594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 191/384] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:51.115081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf0bf3-9b1d-46fe-a56c-512cc369d210 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:51.213054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:51.245163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf0bf3-9b1d-46fe-a56c-512cc369d210 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:51.287818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:51.288837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:51.288837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:51.289000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:51.302767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:51.313061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:51.314377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:51.315184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 194/385] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:51.320994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e204-0b3e-4abd-87d9-769555c5d96f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:51.371778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:51.531084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2825289-f838-4618-9ec8-c293fe1da80d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:51.543465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e204-0b3e-4abd-87d9-769555c5d96f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:51.597399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:51.598047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:51.598326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:51.598597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:51.609067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:51.609678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:51.609945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:51.610211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:51.610875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:51.611183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:51.612570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:51.616011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:51.621487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:51.628097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:51.629824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:51.631095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:51.632352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 195/386] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:51.636536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 192/387] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:51.641311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:51.642710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:51.739330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:51.822683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e25cfe-a06e-4b06-bcf4-f91bdcfad1bb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:51.849677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87666914-c4e8-4f35-8b63-b88a2c349f58 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:51.866322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:51.866957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:51.867240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:51.867512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:51.868220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:51.868528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:51.869914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:51.886109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 193/388] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:51.892660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:51.929957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:51.930607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:51.930889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:51.931162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:51.932319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:51.933774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:51.936200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 196/389] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:51 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:51.942431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:52.025609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:52.072229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e127b97-f925-4dbf-953b-52585dbd3dd5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:52.139519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:52.140442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.141214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958665e-d7ca-4991-8861-3f1c53a36645 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:52.141638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.143436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.144987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:52.147572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:52.150813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 197/390] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:51 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:52.157326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:52.172842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:52.213483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:52.214569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.215141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.215653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.217192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:52.218940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:52.221174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 194/391] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:51 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:52.226846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:52.333007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624542d9-1df3-4493-b458-4ec2488bd2a3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:52.367897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c16849-acb9-46a4-b8fd-299454d40aac None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:52.368427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:52.369346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.369836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.370301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.371840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:52.373640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:52.380443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 195/392] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:52 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:52.381559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:52.433508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d417198-7a34-4e69-81ab-cb28f4813da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:52.434109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417198-7a34-4e69-81ab-cb28f4813da3 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.434391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417198-7a34-4e69-81ab-cb28f4813da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.434665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d417198-7a34-4e69-81ab-cb28f4813da3 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f/groups/4e7698c94142483a896806650a4b8701/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.439986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:52.440988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d417198-7a34-4e69-81ab-cb28f4813da3 None admin] RBAC: Authorizing `identity:create_grant(project_id=161e8f5438d748f1af7b50998d9eda1f, group_id=4e7698c94142483a896806650a4b8701, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:52.442440 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d417198-7a34-4e69-81ab-cb28f4813da3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:52.450621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:52.472819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 198/393] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 05:15:52 2022] PUT /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f/groups/4e7698c94142483a896806650a4b8701/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:52.519155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a258c5c-9e98-48b6-9150-36f74c8bedc2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:52.579534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd334-7e99-4895-82ea-8d9f3ea95a36 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.580212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd334-7e99-4895-82ea-8d9f3ea95a36 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.580212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dd334-7e99-4895-82ea-8d9f3ea95a36 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.581219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c337369-66b8-4964-864f-1f5ee069651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:52.581620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 199/394] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:52.581966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337369-66b8-4964-864f-1f5ee069651f None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.582229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337369-66b8-4964-864f-1f5ee069651f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.582503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337369-66b8-4964-864f-1f5ee069651f None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f/groups/4e7698c94142483a896806650a4b8701/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.584881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c337369-66b8-4964-864f-1f5ee069651f None admin] RBAC: Authorizing `identity:create_grant(project_id=161e8f5438d748f1af7b50998d9eda1f, group_id=4e7698c94142483a896806650a4b8701, role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:52.586352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c337369-66b8-4964-864f-1f5ee069651f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:52.588877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62299c6-f709-42fd-bc0e-ab8cb63b90e7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.589445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62299c6-f709-42fd-bc0e-ab8cb63b90e7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.589911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62299c6-f709-42fd-bc0e-ab8cb63b90e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.612200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f62299c6-f709-42fd-bc0e-ab8cb63b90e7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:52.613977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f62299c6-f709-42fd-bc0e-ab8cb63b90e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:52.614782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 196/395] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 05:15:52 2022] PUT /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f/groups/4e7698c94142483a896806650a4b8701/roles/849d3aaa045348b78fb1017e4080b01c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:52.709299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 200/396] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:52.936448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91255811-fda1-4454-a6f3-7ac821d06120 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.936848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91255811-fda1-4454-a6f3-7ac821d06120 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.936971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91255811-fda1-4454-a6f3-7ac821d06120 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.938939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 197/397] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:52.944930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa819d-dac3-4f9f-a74b-12436c87e62c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:52.945454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa819d-dac3-4f9f-a74b-12436c87e62c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:52.945924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa819d-dac3-4f9f-a74b-12436c87e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:52.968454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-beaa819d-dac3-4f9f-a74b-12436c87e62c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:52.969567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-beaa819d-dac3-4f9f-a74b-12436c87e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:53.006152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91255811-fda1-4454-a6f3-7ac821d06120 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.051680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 201/398] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:53.142115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91255811-fda1-4454-a6f3-7ac821d06120 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:53.156236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:53.186406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:53.187104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.187385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.187740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.190092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50dd9-463c-4cb1-a20a-83cba04c06d7 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.190602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50dd9-463c-4cb1-a20a-83cba04c06d7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.191051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de50dd9-463c-4cb1-a20a-83cba04c06d7 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.192647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 202/399] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:15:53.197788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061bdcc-2ce5-4c11-9aa8-1442ff078541 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.198072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061bdcc-2ce5-4c11-9aa8-1442ff078541 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.200333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061bdcc-2ce5-4c11-9aa8-1442ff078541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.202873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:53.212033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:53.212918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:53.213701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:53.218995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 198/400] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:53.225940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.237016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a061bdcc-2ce5-4c11-9aa8-1442ff078541 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:53.238221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a061bdcc-2ce5-4c11-9aa8-1442ff078541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:53.330730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:53.370394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d40262-15f1-41bb-bf2a-94fb2fe30785 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:53.379982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 203/401] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:53.393544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061bdcc-2ce5-4c11-9aa8-1442ff078541 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.408643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:53.409504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.409973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.410411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.411726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:53.412170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:53.413743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:53.424746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 199/402] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:53.430764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.499144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:53.526550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061bdcc-2ce5-4c11-9aa8-1442ff078541 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:53.563742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:53.564559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.564946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.565330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.586988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:53.592297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:53.593269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:53.594101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:53.604225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 204/403] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:53.609372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d9f87-103f-40ca-8e2c-c5aad5b8519d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:53.610107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.665408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:53.666630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.667868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.668540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.672437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:53.674952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:53.679533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 200/404] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:53.680714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.698202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:53.760784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873892-17c3-4932-9dc9-44ef118bb041 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:53.786138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:53.790797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f61707-066a-4c66-aed2-a0b1a681f655 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:53.802981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:53.803636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.803919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.804193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.804863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:53.805164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:53.807183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:53.822700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 205/405] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:53.823997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.832160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:53.833109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:53.833586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:53.834074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:53.845233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:53.850410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:53.851334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:53.852264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:53.854929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 201/406] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:53.855943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:53.949171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d669a-fec2-47d8-af6f-f77e940cc3ff None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:53.957862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:53.971587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556298-dc54-4c7f-9aa0-e033b6c9e7bb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.000180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.001932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.002713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.003190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.005340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.007472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.016936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 206/407] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:54.017717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:54.022705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.023025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.023345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.023641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.024759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.026266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.027913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 202/408] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:53 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:54.028632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:54.056815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:54.134841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787b01d-c4d0-4cac-a84f-b0a6abb160cf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.158534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb218bd8-b209-4315-b6f7-b26bc16c651a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.170089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.170787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.171098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.171433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52/groups/4e7698c94142483a896806650a4b8701/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.173487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=65df074f839b49e3a0dbada68f63cc52, group_id=4e7698c94142483a896806650a4b8701, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.175004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.199574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 203/409] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 05:15:54 2022] PUT /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52/groups/4e7698c94142483a896806650a4b8701/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:54.199574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:54.215777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.216926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.218019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.218470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.219337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:54.219843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.221487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.244340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 207/410] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:54.252020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:54.336507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:54.375486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:54.407533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a12d5e-548b-4642-8172-bdc3771796f6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.463264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.463941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.464216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.464757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.465298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9ae97-e323-49a2-b268-8461da8dccd9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.465977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.468503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.471466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 204/411] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:54 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:54.480535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:54.513889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.515314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.516077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.516535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] PATH_INFO: `/v3/groups/e33b014e5d37487393d21d57494f28ed` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.517845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] RBAC: Authorizing `identity:get_group(group_id=e33b014e5d37487393d21d57494f28ed)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.519414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.521717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 208/412] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:54 2022] GET /identity/v3/groups/e33b014e5d37487393d21d57494f28ed => generated 229 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:54.527445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:54.639002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedf03b-ad6f-4a5a-b731-0e07094c94f1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.689895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c668b16-33aa-4085-a939-0137a5180d45 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.692449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:54.724876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.725630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.725894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.726166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52/groups/4e7698c94142483a896806650a4b8701/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.731611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] RBAC: Authorizing `identity:create_grant(project_id=65df074f839b49e3a0dbada68f63cc52, group_id=4e7698c94142483a896806650a4b8701, role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.731611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.744395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1bd95-365a-4ba7-9cf1-87aac3e67b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.745051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd95-365a-4ba7-9cf1-87aac3e67b82 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.745361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd95-365a-4ba7-9cf1-87aac3e67b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.745634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1bd95-365a-4ba7-9cf1-87aac3e67b82 None admin] PATH_INFO: `/v3/projects/2e12d4768420490681bee18f38969146` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.746810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1bd95-365a-4ba7-9cf1-87aac3e67b82 None admin] RBAC: Authorizing `identity:get_project(project_id=2e12d4768420490681bee18f38969146)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.747597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 205/413] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 05:15:54 2022] PUT /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52/groups/4e7698c94142483a896806650a4b8701/roles/849d3aaa045348b78fb1017e4080b01c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:54.748344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1bd95-365a-4ba7-9cf1-87aac3e67b82 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.750080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 209/414] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:54 2022] GET /identity/v3/projects/2e12d4768420490681bee18f38969146 => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:54.756322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:54.780286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:54.876872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8f1c5-0c97-460e-b0a4-06af1e01b473 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:54.919436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c958b-ffe7-48ad-a530-904ba84998d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:54.920869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c958b-ffe7-48ad-a530-904ba84998d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:54.921351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c958b-ffe7-48ad-a530-904ba84998d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:54.921822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c958b-ffe7-48ad-a530-904ba84998d1 None admin] PATH_INFO: `/v3/projects/2e12d4768420490681bee18f38969146/groups/e33b014e5d37487393d21d57494f28ed/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:54.924348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c958b-ffe7-48ad-a530-904ba84998d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e12d4768420490681bee18f38969146, group_id=e33b014e5d37487393d21d57494f28ed, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:54.926206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c958b-ffe7-48ad-a530-904ba84998d1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:54.957969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 206/415] 10.222.0.18 () {58 vars in 1442 bytes} [Mon Sep 26 05:15:54 2022] PUT /identity/v3/projects/2e12d4768420490681bee18f38969146/groups/e33b014e5d37487393d21d57494f28ed/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:15:55.054235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659337-a887-408a-b2a3-7faf1fedbf79 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:55.054580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659337-a887-408a-b2a3-7faf1fedbf79 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:55.054776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659337-a887-408a-b2a3-7faf1fedbf79 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:55.056199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 210/416] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:55.064264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615993d-4ffe-437d-8690-ff6aace85a0d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:55.064862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615993d-4ffe-437d-8690-ff6aace85a0d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:55.065327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615993d-4ffe-437d-8690-ff6aace85a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:55.087090 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8615993d-4ffe-437d-8690-ff6aace85a0d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:55.088762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8615993d-4ffe-437d-8690-ff6aace85a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:55.176741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 207/417] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:55.389369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa080d2-a8a6-4b4a-b219-4fd050236294 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:55.389618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa080d2-a8a6-4b4a-b219-4fd050236294 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:55.389868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa080d2-a8a6-4b4a-b219-4fd050236294 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:55.391408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 211/418] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:55.396813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366de7e-286d-4977-8700-fdb370b92aaf None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:55.397325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366de7e-286d-4977-8700-fdb370b92aaf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:55.397792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366de7e-286d-4977-8700-fdb370b92aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:55.406054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:55.423381 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7366de7e-286d-4977-8700-fdb370b92aaf None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:55.428276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7366de7e-286d-4977-8700-fdb370b92aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:55.461886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa080d2-a8a6-4b4a-b219-4fd050236294 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:55.527105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 208/419] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:55.617225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa080d2-a8a6-4b4a-b219-4fd050236294 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:55.661038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:55.661677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:55.661955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:55.662223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:55.678400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:55.683184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:55.684110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:55.684937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 212/420] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:55.692410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366de7e-286d-4977-8700-fdb370b92aaf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:55.859840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366de7e-286d-4977-8700-fdb370b92aaf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:55.903574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:55.904280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:55.904565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:55.904839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:55.905554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] RBAC: Adding query filter params (name=member) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:55.905855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:55.907240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:55.912790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:55.920483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 209/421] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:55.926143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:55.960208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:56.006802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:56.067306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec3c6f-9292-4a0e-aa47-d23a284c183b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:56.109248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:56.110240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.110952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.112145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.224364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cc02f-1828-4bac-9701-fcef635fb532 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:56.244756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:56.246318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:56.277321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:56.302473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:56.303530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.303967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.304478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.325428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:56.338354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:56.339447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:15:56.340487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 210/422] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:56.344489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:56.353919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 213/423] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:56.359516 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:56.472948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:56.491489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668c0f4-2efa-41ff-97b3-5b3af6eb2708 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:56.549652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:56.559011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:56.559693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.560030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.560246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.562266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:56.564109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:56.565955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 214/424] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:56 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:56.567762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2847e7-ff49-4023-9e05-bd8f7d823dff None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:56.571136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:56.650518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:56.651135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.651413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.651712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.652389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:56.652690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:56.654073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:56.674489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2e48c-5430-484f-b815-44607db23cb4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:56.674897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 211/425] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:56.681202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:56.714044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:56.714686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.715058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.715333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.716673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:56.718327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:56.720371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 215/426] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:56 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:56.726343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:56.804283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:56.836036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004e59-c07e-4b08-bb75-b6085255ec17 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:56.874793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5fad-bd9b-4d83-a6cf-b830a8733286 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:56.875859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913e51d-1534-4a59-b1e1-1ccb8fd49366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:56.876649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e51d-1534-4a59-b1e1-1ccb8fd49366 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.876938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e51d-1534-4a59-b1e1-1ccb8fd49366 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.877332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913e51d-1534-4a59-b1e1-1ccb8fd49366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.878788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913e51d-1534-4a59-b1e1-1ccb8fd49366 None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=161e8f5438d748f1af7b50998d9eda1f) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:56.879109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913e51d-1534-4a59-b1e1-1ccb8fd49366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:56.880606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913e51d-1534-4a59-b1e1-1ccb8fd49366 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:56.888710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 216/427] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:56 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=834907900e824380a50e9ef4e00765c7 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:56.890205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5b0ad-db5a-4f1a-95c6-a176b01d2cd9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.890486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5b0ad-db5a-4f1a-95c6-a176b01d2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.890765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5b0ad-db5a-4f1a-95c6-a176b01d2cd9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.892375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 217/428] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:56.901131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815082a-9716-4bd0-a14c-44de19b0b76f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.901487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815082a-9716-4bd0-a14c-44de19b0b76f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.901680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815082a-9716-4bd0-a14c-44de19b0b76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.903507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:56.943859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:56.944783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:56.945203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:56.945707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:56.948717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b815082a-9716-4bd0-a14c-44de19b0b76f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:56.949949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b815082a-9716-4bd0-a14c-44de19b0b76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:57.054634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:57.056157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:57.084891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 218/429] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:57.176953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 212/430] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 05:15:57.182692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815082a-9716-4bd0-a14c-44de19b0b76f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:57.253531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:57.303775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815082a-9716-4bd0-a14c-44de19b0b76f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:57.347675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:57.348271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.348552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.348826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] PATH_INFO: `/v3/projects/161e8f5438d748f1af7b50998d9eda1f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.349961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] RBAC: Authorizing `identity:get_project(project_id=161e8f5438d748f1af7b50998d9eda1f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:57.351402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:57.353317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 219/431] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:57 2022] GET /identity/v3/projects/161e8f5438d748f1af7b50998d9eda1f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:57.360284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:57.388703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:57.409701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:57.503109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f942b32-4377-4b99-907a-f4b0542fccb5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:57.537132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85635a53-ad2c-450f-b867-d3b85fde8f45 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:57.554017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a410f-3c9a-4829-be54-9c11ebc11713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:57.555599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a410f-3c9a-4829-be54-9c11ebc11713 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.556194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a410f-3c9a-4829-be54-9c11ebc11713 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.556476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a410f-3c9a-4829-be54-9c11ebc11713 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.557691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a410f-3c9a-4829-be54-9c11ebc11713 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:57.559457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a410f-3c9a-4829-be54-9c11ebc11713 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:57.561747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 213/432] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:57 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:57.562795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ccc0-f835-4eb7-8f5e-77092aca116b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.563137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ccc0-f835-4eb7-8f5e-77092aca116b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.563779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698ccc0-f835-4eb7-8f5e-77092aca116b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.565082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 214/433] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:57.568365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698ccc0-f835-4eb7-8f5e-77092aca116b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:57.583757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:57.589168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d4620-eeba-4756-941c-3e808d15f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:57.589873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4620-eeba-4756-941c-3e808d15f09c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.590154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4620-eeba-4756-941c-3e808d15f09c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.590427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d4620-eeba-4756-941c-3e808d15f09c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.602203 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d4620-eeba-4756-941c-3e808d15f09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d79d4620-eeba-4756-941c-3e808d15f09c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:57.607387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:57.608519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:57.609314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 220/434] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:57.610616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698ec3f-672b-4947-9fe7-9a8559e5595a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.610904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698ec3f-672b-4947-9fe7-9a8559e5595a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.611173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698ec3f-672b-4947-9fe7-9a8559e5595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.632950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d698ec3f-672b-4947-9fe7-9a8559e5595a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:57.634179 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d698ec3f-672b-4947-9fe7-9a8559e5595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:57.680948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:57.704238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698ccc0-f835-4eb7-8f5e-77092aca116b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:57.723188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 221/435] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:15:57.724484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698ec3f-672b-4947-9fe7-9a8559e5595a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:57.741710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2011c4-7f3d-49b5-849c-c2e211ec4119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:57.742330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2011c4-7f3d-49b5-849c-c2e211ec4119 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.742921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2011c4-7f3d-49b5-849c-c2e211ec4119 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.743198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2011c4-7f3d-49b5-849c-c2e211ec4119 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.744127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2011c4-7f3d-49b5-849c-c2e211ec4119 None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=161e8f5438d748f1af7b50998d9eda1f) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:57.744437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2011c4-7f3d-49b5-849c-c2e211ec4119 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:57.746164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2011c4-7f3d-49b5-849c-c2e211ec4119 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:57.752392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 215/436] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:57 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=161e8f5438d748f1af7b50998d9eda1f&role.id=849d3aaa045348b78fb1017e4080b01c => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:57.756910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc3b9-5647-4f88-b6a2-81a4389446ed None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.757190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc3b9-5647-4f88-b6a2-81a4389446ed None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.757457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc3b9-5647-4f88-b6a2-81a4389446ed None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.758963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 216/437] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:15:57.764746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931fff9-8aba-4dda-97ca-167c04a154c9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.765030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931fff9-8aba-4dda-97ca-167c04a154c9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.765297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931fff9-8aba-4dda-97ca-167c04a154c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.785144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2931fff9-8aba-4dda-97ca-167c04a154c9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:15:57.786374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2931fff9-8aba-4dda-97ca-167c04a154c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:15:57.850995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698ec3f-672b-4947-9fe7-9a8559e5595a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:57.868079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 217/438] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:15:57.873378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:57.889401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:57.890232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:57.890612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:57.891039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:57.891863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] RBAC: Adding query filter params (name=member) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:57.892271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:57.893875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:57.904111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 222/439] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:15:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:57.912977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931fff9-8aba-4dda-97ca-167c04a154c9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:57.997556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.003152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.029714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931fff9-8aba-4dda-97ca-167c04a154c9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.069336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.069992 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.070352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.070623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.133843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7d63-1f28-46ca-8385-180a40151812 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.163841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.166262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.174892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.175563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.175859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.176128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.187104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:58.192253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:58.193292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:58.194270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 223/440] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:15:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:15:58.195060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.249006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.261228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.285282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 218/441] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:58.285282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.308652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759bfee-833d-4946-a1ef-7b5af867594d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.342023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.342652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.342928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.343203 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.354143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:15:58.358946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:15:58.360119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 224/442] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:15:58.361057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.383784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6545c4-cf5d-4340-8a00-8cc9a1b1f551 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.417799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.418323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.418601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.418863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.419520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:58.419878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.421265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.429187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 219/443] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:58.429972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.461129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd6ea5-7d06-42dd-a9a8-a77202b18614 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.462654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.471902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.495754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.496397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.496676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.496951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.498132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.499715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.501368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 225/444] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:58.502124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.530484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29544d-8262-4c16-91ff-583e419bc68f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.566911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.567511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.567826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.568085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.568743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:58.569046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.570414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.578764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 220/445] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:58.579368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.603249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30574b0-489c-49a4-929f-ff651d3029f5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.637470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124422c-9f96-420f-915d-698134f2523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.638381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124422c-9f96-420f-915d-698134f2523f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.638885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124422c-9f96-420f-915d-698134f2523f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.639290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124422c-9f96-420f-915d-698134f2523f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.678036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.678952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b100ecb-80b1-4631-adcd-0c38156868ea None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.681731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.707163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124422c-9f96-420f-915d-698134f2523f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.708651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1124422c-9f96-420f-915d-698134f2523f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.712771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.713401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.713683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.713955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.715065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.716553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.718119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 221/446] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:58.718874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.811059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 226/447] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:58.811838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124422c-9f96-420f-915d-698134f2523f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:58.821165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ee5d9-555a-4a1f-ad9d-41b2393a4408 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.854186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.854791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.855071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.855346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.877540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.895438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:58.907999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124422c-9f96-420f-915d-698134f2523f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:58.922993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.924505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.942943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:58.943475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:58.943782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:58.944054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:58.944778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=834907900e824380a50e9ef4e00765c7, scope.project.id=65df074f839b49e3a0dbada68f63cc52) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:58.945085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:58.946519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:58.952237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 227/448] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=834907900e824380a50e9ef4e00765c7 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:58.953017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:59.034773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 222/449] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:15:59.040572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:59.065614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d6ef9-50d9-46e0-b8f8-48bc848ed86e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:59.104564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:59.105336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:59.105605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:59.105881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] PATH_INFO: `/v3/projects/65df074f839b49e3a0dbada68f63cc52` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:59.107228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] RBAC: Authorizing `identity:get_project(project_id=65df074f839b49e3a0dbada68f63cc52)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:59.108742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:59.115790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:59.116127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 228/450] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:58 2022] GET /identity/v3/projects/65df074f839b49e3a0dbada68f63cc52 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:59.117121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:59.120156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:59.154444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddc663-860d-4986-8c90-a169132d9810 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:59.190017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:59.190655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:59.190934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:59.191200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] PATH_INFO: `/v3/projects/2e12d4768420490681bee18f38969146` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:59.192525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2e12d4768420490681bee18f38969146)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:59.194494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:59.196526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 223/451] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:15:59 2022] GET /identity/v3/projects/2e12d4768420490681bee18f38969146 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:59.202314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:59.234574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6cdb8-f068-4a8e-8668-a6e764d63fda None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:59.275772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:59.276408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:59.276684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:59.276954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] PATH_INFO: `/v3/groups/4e7698c94142483a896806650a4b8701` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:59.278210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] RBAC: Authorizing `identity:get_group(group_id=4e7698c94142483a896806650a4b8701)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:59.280702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:59.281668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 229/452] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:59 2022] GET /identity/v3/groups/4e7698c94142483a896806650a4b8701 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:59.287354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:59.327234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbac7-819f-432e-9778-0eb41ba377c4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:59.363351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:59.364080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:59.364353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:59.364629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] PATH_INFO: `/v3/groups/e33b014e5d37487393d21d57494f28ed` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:59.365703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] RBAC: Authorizing `identity:get_group(group_id=e33b014e5d37487393d21d57494f28ed)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:59.366289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:59.367138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:59.373662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 224/453] 10.222.0.18 () {56 vars in 1180 bytes} [Mon Sep 26 05:15:59 2022] GET /identity/v3/groups/e33b014e5d37487393d21d57494f28ed => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:15:59.374682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:15:59.384994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:15:59.398478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b0f3d-4108-4155-88e3-e5980b360fab None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:59.430724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2d072-2fc8-443e-9c16-bab072750d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:59.431327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2d072-2fc8-443e-9c16-bab072750d3f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:59.431630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2d072-2fc8-443e-9c16-bab072750d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:59.431900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2d072-2fc8-443e-9c16-bab072750d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:59.432620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2d072-2fc8-443e-9c16-bab072750d3f None admin] RBAC: Adding query filter params (group.id=4e7698c94142483a896806650a4b8701, role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=65df074f839b49e3a0dbada68f63cc52) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:59.432926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2d072-2fc8-443e-9c16-bab072750d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:59.434351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2d072-2fc8-443e-9c16-bab072750d3f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:59.440328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 230/454] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:59 2022] GET /identity/v3/role_assignments?group.id=4e7698c94142483a896806650a4b8701&scope.project.id=65df074f839b49e3a0dbada68f63cc52&role.id=849d3aaa045348b78fb1017e4080b01c => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:15:59.474477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fb607-4745-4b29-a9e7-9b373dacfeba None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:15:59.515988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0fe3a0-6a75-4cec-9878-c55afc6cfea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:15:59.516585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fe3a0-6a75-4cec-9878-c55afc6cfea1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:15:59.516862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fe3a0-6a75-4cec-9878-c55afc6cfea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:15:59.517129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0fe3a0-6a75-4cec-9878-c55afc6cfea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:15:59.517873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fe3a0-6a75-4cec-9878-c55afc6cfea1 None admin] RBAC: Adding query filter params (group.id=e33b014e5d37487393d21d57494f28ed, role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=2e12d4768420490681bee18f38969146) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:15:59.518215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fe3a0-6a75-4cec-9878-c55afc6cfea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:15:59.519704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0fe3a0-6a75-4cec-9878-c55afc6cfea1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:15:59.526859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 225/455] 10.222.0.18 () {56 vars in 1376 bytes} [Mon Sep 26 05:15:59 2022] GET /identity/v3/role_assignments?group.id=e33b014e5d37487393d21d57494f28ed&scope.project.id=2e12d4768420490681bee18f38969146&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:02.342441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221819f8-ec44-4e02-a60b-c11250eaba8a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:02.342999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221819f8-ec44-4e02-a60b-c11250eaba8a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:02.342999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221819f8-ec44-4e02-a60b-c11250eaba8a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:02.344630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 231/456] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:02.350159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca125-5781-4f08-b35e-c4c622639612 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:02.350557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca125-5781-4f08-b35e-c4c622639612 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:02.350738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ca125-5781-4f08-b35e-c4c622639612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:02.380511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b53ca125-5781-4f08-b35e-c4c622639612 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:02.381720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b53ca125-5781-4f08-b35e-c4c622639612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:02.466697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 226/457] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:02.678581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a864c-a110-45f3-b9cb-ef911b95082e None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:02.678990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a864c-a110-45f3-b9cb-ef911b95082e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:02.679169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a864c-a110-45f3-b9cb-ef911b95082e None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:02.680788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 232/458] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:02.686158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc42a0-1933-40ca-82c9-22ac3983eb50 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:02.686443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc42a0-1933-40ca-82c9-22ac3983eb50 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:02.686719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc42a0-1933-40ca-82c9-22ac3983eb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:02.693481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:02.706965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-eadc42a0-1933-40ca-82c9-22ac3983eb50 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:02.708203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eadc42a0-1933-40ca-82c9-22ac3983eb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:02.716082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208298e-030f-4346-8ebd-c8f41774687c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:02.716358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208298e-030f-4346-8ebd-c8f41774687c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:02.716795 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208298e-030f-4346-8ebd-c8f41774687c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:02.718461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 233/459] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:02.723566 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a00dc-b082-437d-9289-7c657103e298 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:02.723843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a00dc-b082-437d-9289-7c657103e298 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:02.724114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a00dc-b082-437d-9289-7c657103e298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:02.754363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-013a00dc-b082-437d-9289-7c657103e298 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:02.755757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-013a00dc-b082-437d-9289-7c657103e298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:02.817725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 227/460] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:02.818726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc42a0-1933-40ca-82c9-22ac3983eb50 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:02.842292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 234/461] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:16:02.925219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc42a0-1933-40ca-82c9-22ac3983eb50 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:02.965922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:02.971525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc15b-5c16-4bd5-bcc0-b6091862cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:02.972198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc15b-5c16-4bd5-bcc0-b6091862cf81 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:02.972538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc15b-5c16-4bd5-bcc0-b6091862cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:02.972810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc15b-5c16-4bd5-bcc0-b6091862cf81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:02.987358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bc15b-5c16-4bd5-bcc0-b6091862cf81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:02.988855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bc15b-5c16-4bd5-bcc0-b6091862cf81 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-8d6bc15b-5c16-4bd5-bcc0-b6091862cf81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:03.004930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:03.005876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:03.006702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:03.006702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.006702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:03.006702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 228/462] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:03.013600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a00dc-b082-437d-9289-7c657103e298 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.022413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fb66c-3e58-4b0a-bd7d-fd30a42a99f5 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.022709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fb66c-3e58-4b0a-bd7d-fd30a42a99f5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.022982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fb66c-3e58-4b0a-bd7d-fd30a42a99f5 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.024573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 229/463] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:03.033489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08437-82c3-4edd-afc5-1eb0d795be28 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.033489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08437-82c3-4edd-afc5-1eb0d795be28 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.033489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb08437-82c3-4edd-afc5-1eb0d795be28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.049827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8eb08437-82c3-4edd-afc5-1eb0d795be28 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:03.051222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8eb08437-82c3-4edd-afc5-1eb0d795be28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:03.120834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 230/464] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:03.160640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08437-82c3-4edd-afc5-1eb0d795be28 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.193824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:03.212229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a00dc-b082-437d-9289-7c657103e298 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.248415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.248976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.249192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.249415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.250060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:03.250361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.251944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.264390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 235/465] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:03.265206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.331405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb08437-82c3-4edd-afc5-1eb0d795be28 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.350162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:03.375532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.376600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.376886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.377160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.382660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070aa21-ff68-495f-9169-4e76a1fc2342 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.390333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.392348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.408173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:03.413707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:03.414641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:03.415512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:03.415512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.415512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:03.415512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 231/466] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:03.419775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.427336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.428201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.428647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.429063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.441539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.443220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:03.458549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:03.459647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:03.460528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:03.460528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.460528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:03.460528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 236/467] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:03.460528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.526693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab233aed-f3af-42a0-9d52-f9b3e9996b35 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.565560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.566183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.566461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.566735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.567402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.568924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.574007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a405-4f75-4eb9-8331-098eae405f59 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.599581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 232/468] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:16:03 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:03.599581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.625844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.626628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.626984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.627331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.628227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:03.629399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:03.629787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.631335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.651076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 237/469] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:03.652323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.695856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:03.729404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d27f5-1b5d-4643-b377-550f7fb3a090 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.767304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.768105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.768386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.768667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.774498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b668a-9544-413b-a3de-8412722bc5f8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.781245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.782664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:03.798411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:03.799341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:03.801348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:03.801348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:03.801348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:03.803678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 233/470] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:03.804792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.817256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e9271-15ff-4622-9067-787b6a380a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.818598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9271-15ff-4622-9067-787b6a380a93 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.818881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9271-15ff-4622-9067-787b6a380a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.819149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9271-15ff-4622-9067-787b6a380a93 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.819845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9271-15ff-4622-9067-787b6a380a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:03.820139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9271-15ff-4622-9067-787b6a380a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.821494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e9271-15ff-4622-9067-787b6a380a93 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.834296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 238/471] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:03.835923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dd0b-5e28-4d08-9597-fa8bd2e020e1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.836340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dd0b-5e28-4d08-9597-fa8bd2e020e1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.836787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dd0b-5e28-4d08-9597-fa8bd2e020e1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.838403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 239/472] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:03.839258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dd0b-5e28-4d08-9597-fa8bd2e020e1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.896724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:03.924990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec0e6e-7e2c-40cd-9832-ac21572be1e4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.949212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:03.957141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dd0b-5e28-4d08-9597-fa8bd2e020e1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:03.960714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.961327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.961596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.961859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.962509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.963990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:03.985807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 234/473] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:16:03 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:03.989084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:03.995014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7f32-191a-490d-8ae5-407800c2e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:03.995233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7f32-191a-490d-8ae5-407800c2e84d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:03.995470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7f32-191a-490d-8ae5-407800c2e84d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:03.995748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7f32-191a-490d-8ae5-407800c2e84d None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:03.996421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7f32-191a-490d-8ae5-407800c2e84d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:03.996803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7f32-191a-490d-8ae5-407800c2e84d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:03.998913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7f32-191a-490d-8ae5-407800c2e84d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:04.018885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 240/474] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:04.020516 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251048e-c315-4552-89cb-d78671d185c7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:04.020628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251048e-c315-4552-89cb-d78671d185c7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:04.020862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251048e-c315-4552-89cb-d78671d185c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:04.041966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9251048e-c315-4552-89cb-d78671d185c7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:04.043444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9251048e-c315-4552-89cb-d78671d185c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:04.133812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 241/475] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:04.135874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251048e-c315-4552-89cb-d78671d185c7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:04.137692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfcb5e-bb6c-4d57-bcbb-412fc3abd621 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:04.171628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:04.183924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:04.184848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:04.185681 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:04.186176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:04.187913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:04.189980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:04.221740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 235/476] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:16:03 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:04.252938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:04.273442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251048e-c315-4552-89cb-d78671d185c7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:04.314259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:04.314801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:04.315077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:04.315345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:04.316043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:04.317510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:04.343724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 242/477] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:16:04 2022] POST /identity/v3/users => generated 249 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:04.423807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:04.548982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641143a-1d28-4551-9ed2-2719a9311844 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:04.586016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:04.586557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:04.586834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:04.587097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:04.587814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:04.589204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:04.600005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.sql.core [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 05:16:04.600005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 05:16:04.600005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [parameters: {'id': '3aa0abde3f3c42fd96a67cc1c73dbc4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 05:16:04.600005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81592) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result.read() Sep 26 05:16:04.617517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return ref.to_dict() Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:16:04.618463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application yield resource Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise self.value Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application session.commit() Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 05:16:04.619385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.session.flush() Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application compat.raise_( Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 05:16:04.621330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:16:04.623404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application result.read() Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:16:04.625605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [parameters: {'id': '3aa0abde3f3c42fd96a67cc1c73dbc4a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:04.627479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 05:16:04.629384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:04.637328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 236/478] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 05:16:04 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:04.637472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:04.733225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257cc7d-c00c-4859-a470-9f102ebc3c07 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:04.769213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc60097-d39e-439c-b1bf-8b84b87eff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:04.770143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60097-d39e-439c-b1bf-8b84b87eff54 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:04.770419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60097-d39e-439c-b1bf-8b84b87eff54 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:04.770684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc60097-d39e-439c-b1bf-8b84b87eff54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:04.781821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc60097-d39e-439c-b1bf-8b84b87eff54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fbc60097-d39e-439c-b1bf-8b84b87eff54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:04.787158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:04.789234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:04.791151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 243/479] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:04.796869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:04.850025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:04.915057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270cd47-d5a3-4cbc-abf7-e7c2babbba6b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:04.966305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624f3bf-cd7b-4417-82f1-3306325e5b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:04.967075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624f3bf-cd7b-4417-82f1-3306325e5b70 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:04.967353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624f3bf-cd7b-4417-82f1-3306325e5b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:04.967659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624f3bf-cd7b-4417-82f1-3306325e5b70 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:04.968370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624f3bf-cd7b-4417-82f1-3306325e5b70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:04.968671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624f3bf-cd7b-4417-82f1-3306325e5b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:04.970059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624f3bf-cd7b-4417-82f1-3306325e5b70 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:04.981522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 237/480] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:06.178421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a823-2e00-4c3a-af0c-73dd97d7113f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:06.179186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a823-2e00-4c3a-af0c-73dd97d7113f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:06.179186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a823-2e00-4c3a-af0c-73dd97d7113f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:06.180590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 244/481] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:06.186134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c3262-593d-4cb8-baac-6c58e342d382 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:06.186665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c3262-593d-4cb8-baac-6c58e342d382 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:06.186665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c3262-593d-4cb8-baac-6c58e342d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:06.208497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-042c3262-593d-4cb8-baac-6c58e342d382 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:06.209750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-042c3262-593d-4cb8-baac-6c58e342d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:06.293360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 238/482] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:06.729157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a823-2e00-4c3a-af0c-73dd97d7113f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:06.732336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:06.794657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71d69-ce7d-4072-bd71-9ab6b9b08cd6 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:06.795409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71d69-ce7d-4072-bd71-9ab6b9b08cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:06.795894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71d69-ce7d-4072-bd71-9ab6b9b08cd6 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:06.797652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 239/483] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:06.804007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3012ae-d672-4bd0-8266-7f76b7fa069e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:06.804495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3012ae-d672-4bd0-8266-7f76b7fa069e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:06.804906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3012ae-d672-4bd0-8266-7f76b7fa069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:06.843087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ab3012ae-d672-4bd0-8266-7f76b7fa069e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:06.844362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ab3012ae-d672-4bd0-8266-7f76b7fa069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:06.865056 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a823-2e00-4c3a-af0c-73dd97d7113f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:06.924537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:06.926793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aeaf1-26fe-41d4-8c55-876e05d860aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:06.930460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aeaf1-26fe-41d4-8c55-876e05d860aa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:06.930956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aeaf1-26fe-41d4-8c55-876e05d860aa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:06.931394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aeaf1-26fe-41d4-8c55-876e05d860aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:06.954309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aeaf1-26fe-41d4-8c55-876e05d860aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-148aeaf1-26fe-41d4-8c55-876e05d860aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:06.960733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:06.961637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:06.962431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:06.964631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 245/484] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:06.970536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaccf16-b54f-4c04-9362-39ed3fabad3b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:06.970536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaccf16-b54f-4c04-9362-39ed3fabad3b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:06.970536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaccf16-b54f-4c04-9362-39ed3fabad3b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:06.970536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 246/485] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:06.971491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaccf16-b54f-4c04-9362-39ed3fabad3b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:06.989759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 240/486] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:16:06.995581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502543-f3af-4147-a16c-0b8d6c59b506 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:06.996296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502543-f3af-4147-a16c-0b8d6c59b506 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:06.996777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9502543-f3af-4147-a16c-0b8d6c59b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.032685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c9502543-f3af-4147-a16c-0b8d6c59b506 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:07.033887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c9502543-f3af-4147-a16c-0b8d6c59b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:07.072991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:07.116812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 241/487] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:07.163192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaccf16-b54f-4c04-9362-39ed3fabad3b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.222008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:07.222693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.222909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.223172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.223895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:07.224202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:07.225625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:07.240355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 247/488] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:07.246033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9502543-f3af-4147-a16c-0b8d6c59b506 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.292250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.402766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9502543-f3af-4147-a16c-0b8d6c59b506 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.405139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:07.425956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b6ffc-bbf2-4713-ac01-d942894e975c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.442701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb23c49-d63a-4e42-a4f1-9b8f44ca5c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:07.443743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23c49-d63a-4e42-a4f1-9b8f44ca5c19 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.444249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23c49-d63a-4e42-a4f1-9b8f44ca5c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.444804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb23c49-d63a-4e42-a4f1-9b8f44ca5c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.453499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:07.458030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb23c49-d63a-4e42-a4f1-9b8f44ca5c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:07.459500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb23c49-d63a-4e42-a4f1-9b8f44ca5c19 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:07.465269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:07.465907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.466184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.466521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-6bb23c49-d63a-4e42-a4f1-9b8f44ca5c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:07.474826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:07.475757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:07.476612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:07.476612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:07.476612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:07.478331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:07.479676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 242/489] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:07.481123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5ff4-8ec5-41e9-b10d-b881d8a6f188 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.481405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5ff4-8ec5-41e9-b10d-b881d8a6f188 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.481680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e5ff4-8ec5-41e9-b10d-b881d8a6f188 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.483683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 243/490] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:07.484249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:07.485119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:07.485907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 248/491] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:07.486565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.488508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5ff4-8ec5-41e9-b10d-b881d8a6f188 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.596134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c18fbc-0056-4ab4-9db2-7f43e366fb43 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.617703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e5ff4-8ec5-41e9-b10d-b881d8a6f188 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.631845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72ecca-c951-4542-aaae-e96a64b6f394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:07.632653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ecca-c951-4542-aaae-e96a64b6f394 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.632761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ecca-c951-4542-aaae-e96a64b6f394 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.632990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72ecca-c951-4542-aaae-e96a64b6f394 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.633638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ecca-c951-4542-aaae-e96a64b6f394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:07.633941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ecca-c951-4542-aaae-e96a64b6f394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:07.635344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72ecca-c951-4542-aaae-e96a64b6f394 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:07.652120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 249/492] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:07.652120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30853d-aab5-4aef-865e-a5e280b26d4e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.652120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30853d-aab5-4aef-865e-a5e280b26d4e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.652120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30853d-aab5-4aef-865e-a5e280b26d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.660953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:07.661595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.661873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.662141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.669230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6a30853d-aab5-4aef-865e-a5e280b26d4e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:07.670626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6a30853d-aab5-4aef-865e-a5e280b26d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:07.673624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:07.678799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:07.679940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 244/493] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:07.685570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.701671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:07.720512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:07.755649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 250/494] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:07.755649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30853d-aab5-4aef-865e-a5e280b26d4e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.802675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311450e-e770-43c3-a85b-5cbbc941a16a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.839949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:07.840723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.841066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.841464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.842764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:07.843141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:07.844687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:07.861795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 245/495] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:07.861795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.891251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30853d-aab5-4aef-865e-a5e280b26d4e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.926317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:07.926921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:07.927206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:07.927477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:07.934942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:07.936580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:07.945334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:07.952323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:07.953242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 251/496] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:07.954228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:07.974672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a474ca9-438f-4f68-a8cc-78ab729ffdac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:07.991114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.014063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f0c3f-75e6-4836-b62f-b686318c0be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.014679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0c3f-75e6-4836-b62f-b686318c0be6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.015018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0c3f-75e6-4836-b62f-b686318c0be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.015216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0c3f-75e6-4836-b62f-b686318c0be6 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.015904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f0c3f-75e6-4836-b62f-b686318c0be6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:08.016214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f0c3f-75e6-4836-b62f-b686318c0be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.017602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f0c3f-75e6-4836-b62f-b686318c0be6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.025524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 246/497] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:08.026687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9848d98-7681-4cea-a8c0-1be1d154227c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.026968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9848d98-7681-4cea-a8c0-1be1d154227c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.027240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9848d98-7681-4cea-a8c0-1be1d154227c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.031650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 247/498] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:08.031650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9848d98-7681-4cea-a8c0-1be1d154227c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.067156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55694c32-6980-4c92-a1c4-2325abf069d4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.100824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.101451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.101725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.101988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.112355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.113733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:08.128326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:08.129337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:08.130185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:08.130185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:08.130185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:08.130185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 252/499] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:08.130185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.137268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9848d98-7681-4cea-a8c0-1be1d154227c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.171312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.171953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.172224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.172487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.173208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:08.173504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.174940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.192682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.212330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 248/500] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:08.213140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.224645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.239462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b65d7-411e-44df-9513-ded3006c5633 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.274122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6f394-ec6a-4bc6-a28b-1dd788ea7467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.274736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6f394-ec6a-4bc6-a28b-1dd788ea7467 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.275027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6f394-ec6a-4bc6-a28b-1dd788ea7467 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.275296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6f394-ec6a-4bc6-a28b-1dd788ea7467 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.286324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6f394-ec6a-4bc6-a28b-1dd788ea7467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e1a6f394-ec6a-4bc6-a28b-1dd788ea7467 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:08.291486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:08.292405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:08.293443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 253/501] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:08.294478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cecb8f-4b46-4e19-b2e9-d80b6de67a18 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.294478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cecb8f-4b46-4e19-b2e9-d80b6de67a18 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.294478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cecb8f-4b46-4e19-b2e9-d80b6de67a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.312270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-14cecb8f-4b46-4e19-b2e9-d80b6de67a18 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:08.313827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-14cecb8f-4b46-4e19-b2e9-d80b6de67a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:08.315693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b406f-69c2-4c12-a71a-6e222161031e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.349415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.350070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.350347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.350617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.361562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.363115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.378285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 254/502] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:08.378423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:08.379296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:08.380518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:08.380518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:08.380518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:08.380680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cecb8f-4b46-4e19-b2e9-d80b6de67a18 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.380746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 249/503] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:08.380746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.444515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.469749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.498661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a63fe-0242-413e-a870-81a0ee83f75c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.498834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cecb8f-4b46-4e19-b2e9-d80b6de67a18 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.534160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.534767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.535044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.535311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.535999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:08.536153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.536322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.536723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.537001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.537268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.537658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.551184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 255/504] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:08.555665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.615611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.617432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.657314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84406e8-f3a2-46a8-8ebb-ca1921c38c6a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.665638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.696397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.696998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.697272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.697540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.698197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:08.698501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.699899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.702325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.716114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 256/505] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:08.716114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.717986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 250/506] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:08.718420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.819349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8a53b-ece0-488c-8b9f-14c2c1cfb4aa None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.820081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799cf9b-ba33-4309-a4a8-8d0060db7807 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.853035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.853634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.853913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.854183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.854819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:08.855116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.856508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.863159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:08.863820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:08.864095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:08.864365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] PATH_INFO: `/v3/users/glance` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:08.868490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 257/507] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:08.869233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.871758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:08.873931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:08.887571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:08.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:08.889510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 251/508] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:08.890222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:08.901669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.936259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:08.977738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2825362-10e6-4d66-a9d5-375e569ba2e8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:08.993175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f8a6f-ff1c-48a9-b88c-89e252e345af None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.012716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.013776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.014592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.014998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.025876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.027436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.027584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85335411-592a-4401-b515-e83977377737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.028104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335411-592a-4401-b515-e83977377737 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.028382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335411-592a-4401-b515-e83977377737 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.028649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85335411-592a-4401-b515-e83977377737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.039273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85335411-592a-4401-b515-e83977377737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.040746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85335411-592a-4401-b515-e83977377737 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:09.042013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:09.042905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:09.043792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:09.043792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:09.043792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:09.043792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 258/509] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:09.044013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-85335411-592a-4401-b515-e83977377737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:09.059307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:09.060641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:09.061726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:09.061726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:09.061726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:09.061726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 252/510] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:09.061726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85335411-592a-4401-b515-e83977377737 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.118767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.151081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b2f38-c63a-4275-b3b4-f5245ad30c4c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.162789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.172265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85335411-592a-4401-b515-e83977377737 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.194236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.194875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.195152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.195419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.206848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.208565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.209158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.209801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.210077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.210344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.218368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.219859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:09.224101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:09.225504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:09.226416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:09.226416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:09.226416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:09.226416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 259/511] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:09.226416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:09.234870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:09.235797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:09.236670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 253/512] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:09.237212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.333153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd43d9-01f8-42bc-821f-ec508fa25076 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.339740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61cebc-b581-425f-82a3-3ad7271e90ac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.359248 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.367037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.367674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.367953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.368222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.369002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:09.369251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.370692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.373280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.373882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.374163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.374435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.375075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:09.375378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.376786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.394079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 254/513] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:09.394891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.410431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 260/514] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:09.415814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.437146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.497122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecffa49-ea7e-46ae-92ec-ab21b432c416 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.514061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e49c6-ddc4-48f5-978f-9706d44b0fb3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.531879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.532482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.532755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.533023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.533661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:09.533959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.535363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.547080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 255/515] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:09.547635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.547880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.548246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.548529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.548801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.549441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:09.549742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.551126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.563564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 261/516] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:09.564379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.597405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.647015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.654720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f4982-a153-4a4b-bd49-ad9733a5ab7c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.667080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44378b26-abe1-48aa-bd79-1b19743c0ccc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.689844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.690451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.690699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.690972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.691740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:09.692048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.693495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.701943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.702584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.702863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.703135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.703817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.705239 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.710272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 256/517] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:09.711071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.729065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 262/518] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:16:09 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:09.729817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.820499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.825343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e437f4-44d6-462e-a88a-8a2e60ca40e7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.866542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce449dd3-d19e-420e-8e9a-0bf162b2c9fd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:09.867651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.868399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.868676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.869042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.905576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:09.906141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:09.906415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:09.906681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:09.909859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:09.914592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.917081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:09.933194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:09.934051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:09.934886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 263/519] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:09.936013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:09.952925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:09.954552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.051698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a090c-3a98-49fe-aa4a-12ca02bec9cb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.054064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.059988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 257/520] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:10.060916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.092016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.092755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.093036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.093314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.102229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.103872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:10.116079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:10.117168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 264/521] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:10.118060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.170311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7eea89-c5f2-4ad6-ac98-7229b46c15ac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.178170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.206994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.207634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.207912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.208210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.225300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188065c-443c-413c-b315-b8c18c67f079 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.260200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.260812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.261091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.261387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.262065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:10.262375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.263894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.279012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.285823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.286930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 265/522] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:10.287902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.288145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.398132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 258/523] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:10.399006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.400410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f7a33-4b8c-45f2-8efe-12c450e0a063 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.419908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.440250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.440862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.441473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.441473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.452372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.453741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:10.469399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:10.470367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:10.471205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:10.471205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:10.471205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:10.477714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 266/524] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:10.477714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.507471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.511525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d968c4-aa90-4e0b-85f6-1f4f91862c58 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.551811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.552428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.552705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.552976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.553709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:10.554013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.555593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.579336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 259/525] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:10.579336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.585068 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e73688-b592-40b9-a1be-cd723e70ac51 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.622513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.623220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.623496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.623823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.624622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=291c79a765764420a4b836c478c385b6) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:10.624946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.626663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.633982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 267/526] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/role_assignments?user.id=291c79a765764420a4b836c478c385b6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:10.634932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.674050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.701830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8444b-dec2-4590-aae1-95c8e9ebed6a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.742524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.742973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.743259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.743529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.756041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.757667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.761234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441a0c-f4e5-46b6-a207-c0029a6dab7d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:10.774736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:10.775799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:10.776729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:10.776729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:10.776729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:10.780876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 260/527] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:10.781998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.794724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.806506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.807564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.808047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.808565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.809493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:10.810090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.812513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.826536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 268/528] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:10.827627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:10.918286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee110693-c2dc-4a28-81f3-f084a365bfac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.924917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:10.934917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0752d3-1656-4e3b-bb47-55db78dde68e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:10.971364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.972037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.972388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.972770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.978528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:10.979141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:10.979417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:10.979718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:10.980366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:10.980664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:10.982113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:10.994318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 269/529] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:10.995229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.051530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.054109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.065869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:11.116664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a19af9-52cc-438d-a311-c4fd0b6f9efa None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.160386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:11.161226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:11.161584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:11.161913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:11.170499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.172147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.181724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 261/530] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:11.182652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:11.185385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:11.186369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:11.187420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:11.191571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 270/531] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:11.191571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.208499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:11.311723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833812f-1734-4628-bd71-d0845d461507 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.320837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7594eb7b-baa0-4efb-b55d-c582e9c3b158 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.323979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:11.361420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:11.362677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:11.363146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:11.363660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:11.370931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:11.371729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:11.372011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:11.372287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:11.373075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.375794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.384490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.385959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:11.392094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:11.393077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:11.393922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:11.401237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 262/532] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:11.402929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:11.407834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:11.408790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:11.410214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:11.410214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:11.410214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:11.410214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 271/533] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:11.410214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.484121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:11.519343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d7c07-bf72-43ff-8d8d-9a8152d969d7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.528020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be9a1e-53ff-45df-b7e7-11c3fb470253 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.556859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:11.557419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:11.557783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:11.558057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:11.558853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:11.559162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.560940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.569923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:11.570614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:11.570960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:11.571299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:11.572100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:11.572594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.574059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.581654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 263/534] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:11.583221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.590000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 272/535] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:11.590923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.617796 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:11.710400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42381f88-bfcd-46a0-a3a1-32ecdbfd7278 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.715778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d84c8-93d7-4e8d-9dfa-55e5509cda7e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.736094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:11.750938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:11.752033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:11.752556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:11.753021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:11.753961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=1d78fc219a25457ca11e38930b03e8ea) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:11.754510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.756202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.760710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:11.761335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:11.761619 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:11.761894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:11.762548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:11.762856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:11.763773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 273/536] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/role_assignments?user.id=1d78fc219a25457ca11e38930b03e8ea&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:11.764297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:11.765117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.780773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 264/537] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:11.790255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:11.957278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:11.966177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dcb75-58df-4487-9e4b-1da894057052 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:11.990436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aad059-f94f-4b95-af1c-7ce8d4c15fb0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:12.007062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d21d6-ae9c-451e-93d6-10cbf930fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:12.008095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d21d6-ae9c-451e-93d6-10cbf930fecf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.008589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d21d6-ae9c-451e-93d6-10cbf930fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.009061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d21d6-ae9c-451e-93d6-10cbf930fecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.009968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d21d6-ae9c-451e-93d6-10cbf930fecf None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=262c0977be384e59a37ef91978012ad6) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:12.010450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d21d6-ae9c-451e-93d6-10cbf930fecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:12.012266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d21d6-ae9c-451e-93d6-10cbf930fecf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:12.021643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 274/538] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/role_assignments?user.id=262c0977be384e59a37ef91978012ad6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:12.023579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e98c8-cbf6-4a44-a6a9-e88786a421a5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.023689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e98c8-cbf6-4a44-a6a9-e88786a421a5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.027577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e98c8-cbf6-4a44-a6a9-e88786a421a5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.027577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 275/539] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:12.031711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed2bc-a10d-4d67-ae3a-2ab14e56bf1b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.032057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed2bc-a10d-4d67-ae3a-2ab14e56bf1b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.032155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:12.032424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ed2bc-a10d-4d67-ae3a-2ab14e56bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.032719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.033001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.033273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.049201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:12.051023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:12.052924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-785ed2bc-a10d-4d67-ae3a-2ab14e56bf1b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:12.054610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-785ed2bc-a10d-4d67-ae3a-2ab14e56bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:12.070937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:12.072014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:12.072875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:12.076244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 265/540] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:12.082268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:12.116327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:12.139633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 276/541] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:16:12.217956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a654a5-cfac-4922-bbc8-295695aa5ef8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:12.266363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:12.266989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.267272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.267566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.268280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:12.268587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:12.270073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:12.283893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 266/542] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:12.291570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ed2bc-a10d-4d67-ae3a-2ab14e56bf1b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:12.427243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ed2bc-a10d-4d67-ae3a-2ab14e56bf1b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:12.431504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:12.443910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:12.465950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:12.466653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.466982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.467358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.468187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=de2913a65aac4fda97bc92dbf15d3316) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:12.468434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:12.469858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:12.476338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 277/543] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:12 2022] GET /identity/v3/role_assignments?user.id=de2913a65aac4fda97bc92dbf15d3316&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:12.546875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9c866-3054-40c1-8869-345ba3a1d7c1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:12.586002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:12.586672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.586952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.587226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.600044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:12.605127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:12.606067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:12.607405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 267/544] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:12.612902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:12.665026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:12.730372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb705e5f-5a52-4737-b267-1a2e44b3a09c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:12.766168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:12.766855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.767138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.767411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.768111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:12.768420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:12.769847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:12.778656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 278/545] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:12.784424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:12.857913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:12.895281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7bb93-2f3b-426e-b586-8a82d32c687a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:12.958742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550ece6-be1d-4db1-a374-c0f0db464cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:12.958742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550ece6-be1d-4db1-a374-c0f0db464cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:12.958742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550ece6-be1d-4db1-a374-c0f0db464cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:12.958742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550ece6-be1d-4db1-a374-c0f0db464cc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:12.971837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550ece6-be1d-4db1-a374-c0f0db464cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:12.973312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550ece6-be1d-4db1-a374-c0f0db464cc6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9550ece6-be1d-4db1-a374-c0f0db464cc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:12.995227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:12.996223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:12.997074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:12.997074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:12.997074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:12.997074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 268/546] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:13.002488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:13.085883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90a39-6ecb-4238-bc96-c4cb52c02151 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:13.086212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90a39-6ecb-4238-bc96-c4cb52c02151 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:13.086432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90a39-6ecb-4238-bc96-c4cb52c02151 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:13.087815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 269/547] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:13.097930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312422c3-c1d8-4012-a5cb-27701b6a2e6a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:13.098221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312422c3-c1d8-4012-a5cb-27701b6a2e6a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:13.098484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312422c3-c1d8-4012-a5cb-27701b6a2e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:13.124252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-312422c3-c1d8-4012-a5cb-27701b6a2e6a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:13.125480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-312422c3-c1d8-4012-a5cb-27701b6a2e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:13.164535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa53ec-6515-4d8b-b22e-2408f864892d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:13.183988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:13.233137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:13.233995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:13.234278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:13.234551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:13.235927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:13.236237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:13.237616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:13.254514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 270/548] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:16:13.259280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 279/549] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:13.265290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312422c3-c1d8-4012-a5cb-27701b6a2e6a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:13.329206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:13.381706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312422c3-c1d8-4012-a5cb-27701b6a2e6a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:13.417349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:13.417992 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:13.418274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:13.418555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:13.426066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:13.427609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:13.439918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:13.441834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:13.442811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 271/550] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:13.447069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:13.555447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd97e2e-173f-43ca-923e-f12806ffd80e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:13.590152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:13.590771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:13.591053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:13.591460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:13.592231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:13.592539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:13.593998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:13.614781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 280/551] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 05:16:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:13.620686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:13.644874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:13.695989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:13.763093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9d9f4-8d5e-4e11-9e54-3f23a18234c0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:13.817473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38927a-4c34-4b78-9214-b3b10949d3ed None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:13.838469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:13.838845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:13.839704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:13.839818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:13.840014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:13.860588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:13.865418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:13.866524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:13.867337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:13.872962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 281/552] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:13.873800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:13.886546 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:13.887272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:13.887567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:13.887839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.018746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:14.020255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:14.043904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:14.093692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfedbe-b00e-4084-9729-a58a6414195e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:14.123809 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 272/553] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:14.132578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:14.153113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:14.169703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:14.170400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.170680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.170955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.171666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:14.171979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:14.173479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:14.182280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 282/554] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:14.188062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:14.339167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7427b-26e0-4dff-a317-647c93997127 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:14.366617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c5731-d8c4-4ace-a7a5-6c903e0cc64e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:14.408051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:14.408694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.409106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.409379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.422078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:14.424780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:14.440058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:14.440705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.441040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.441316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:14.456947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:14.458304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:14.459177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:14.459177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:14.459177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:14.464823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 273/555] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:14.466186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:14.467887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:14.469123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:14.490255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:14.499843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:14.502472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:14.504547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:14.504547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:14.504547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:14.504547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 283/556] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:14.509950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:14.581696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:14.669075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57f6eb-743d-4bc2-aa05-20cf795584f1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:14.673189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cde71f-211d-4d50-84b5-9f37e67f24ec None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:14.724066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:14.724441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4f1bc-3c64-4e73-b7b8-ed400d594160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:14.724845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.725039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f1bc-3c64-4e73-b7b8-ed400d594160 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.725140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.725321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f1bc-3c64-4e73-b7b8-ed400d594160 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.725499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.725595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f1bc-3c64-4e73-b7b8-ed400d594160 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.726189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:14.726293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4f1bc-3c64-4e73-b7b8-ed400d594160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:14.726560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:14.726660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4f1bc-3c64-4e73-b7b8-ed400d594160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:14.727990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:14.728100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4f1bc-3c64-4e73-b7b8-ed400d594160 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:14.743855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 274/558] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:14.744047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 284/558] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:14.745137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabd2cb-71e4-46d5-8089-ba272143e7b3 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.745414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabd2cb-71e4-46d5-8089-ba272143e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.745683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dabd2cb-71e4-46d5-8089-ba272143e7b3 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.746986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 275/559] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:14.752352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:14.752832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241eaa-4ad2-4b9e-8e07-11902a5fc40a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.753352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241eaa-4ad2-4b9e-8e07-11902a5fc40a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.753805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2241eaa-4ad2-4b9e-8e07-11902a5fc40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.775402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f2241eaa-4ad2-4b9e-8e07-11902a5fc40a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:14.777038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f2241eaa-4ad2-4b9e-8e07-11902a5fc40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:14.823032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:14.871625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d585b-5ba2-4d37-a3e5-1660b8d1aab3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:14.875801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 276/560] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:14.876778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241eaa-4ad2-4b9e-8e07-11902a5fc40a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:14.909294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a6ac7-4b35-434f-995b-d8937c0c3ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:14.910382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6ac7-4b35-434f-995b-d8937c0c3ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.910855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6ac7-4b35-434f-995b-d8937c0c3ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.911316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a6ac7-4b35-434f-995b-d8937c0c3ad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.918965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a6ac7-4b35-434f-995b-d8937c0c3ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:14.921055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a6ac7-4b35-434f-995b-d8937c0c3ad4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-020a6ac7-4b35-434f-995b-d8937c0c3ad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:14.935479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:14.936555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:14.937469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:14.940540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 285/561] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:14.942753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4c43a-4d19-4fd4-ae47-e512be260322 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:14.943232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4c43a-4d19-4fd4-ae47-e512be260322 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:14.943707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4c43a-4d19-4fd4-ae47-e512be260322 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:14.946073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 286/562] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:14.948089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4c43a-4d19-4fd4-ae47-e512be260322 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:14.952568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:15.026317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2241eaa-4ad2-4b9e-8e07-11902a5fc40a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.078703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08175b43-432e-44e2-8af5-99be39cedf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.079520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175b43-432e-44e2-8af5-99be39cedf00 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.079911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175b43-432e-44e2-8af5-99be39cedf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.080277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175b43-432e-44e2-8af5-99be39cedf00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.091030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08175b43-432e-44e2-8af5-99be39cedf00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:15.093507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08175b43-432e-44e2-8af5-99be39cedf00 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:15.097557 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4c43a-4d19-4fd4-ae47-e512be260322 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-08175b43-432e-44e2-8af5-99be39cedf00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:15.107608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:15.108868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:15.110049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:15.112073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 277/563] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:16:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:15.112463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095633bf-7026-4421-b1f4-5d614df0fd69 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.112894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095633bf-7026-4421-b1f4-5d614df0fd69 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.113193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095633bf-7026-4421-b1f4-5d614df0fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.130160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:15.134082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-095633bf-7026-4421-b1f4-5d614df0fd69 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:15.135369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-095633bf-7026-4421-b1f4-5d614df0fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:15.147274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6d324-8453-4eb5-a5d8-ad39c32f8f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.147923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6d324-8453-4eb5-a5d8-ad39c32f8f11 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.148202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6d324-8453-4eb5-a5d8-ad39c32f8f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.148470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6d324-8453-4eb5-a5d8-ad39c32f8f11 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.149175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6d324-8453-4eb5-a5d8-ad39c32f8f11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:15.149529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6d324-8453-4eb5-a5d8-ad39c32f8f11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:15.151001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6d324-8453-4eb5-a5d8-ad39c32f8f11 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:15.172816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 287/564] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:15.176314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5be2b-6f4c-469e-bf9f-aa2b96bbe2af None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.176607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5be2b-6f4c-469e-bf9f-aa2b96bbe2af None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.177543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5be2b-6f4c-469e-bf9f-aa2b96bbe2af None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.179602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 288/565] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:15.179602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5be2b-6f4c-469e-bf9f-aa2b96bbe2af None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:15.212916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 278/566] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:15.213568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095633bf-7026-4421-b1f4-5d614df0fd69 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:15.258359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:15.325309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095633bf-7026-4421-b1f4-5d614df0fd69 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.343205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5be2b-6f4c-469e-bf9f-aa2b96bbe2af None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.362438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d53884-ffe7-49a0-b648-2e97331f3235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.363063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d53884-ffe7-49a0-b648-2e97331f3235 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.363337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d53884-ffe7-49a0-b648-2e97331f3235 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.363632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d53884-ffe7-49a0-b648-2e97331f3235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.364353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d53884-ffe7-49a0-b648-2e97331f3235 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=4f85a6800f914551b065fedc9bd4b558) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:15.364671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d53884-ffe7-49a0-b648-2e97331f3235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:15.366105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d53884-ffe7-49a0-b648-2e97331f3235 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:15.372316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 279/567] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/role_assignments?user.id=4f85a6800f914551b065fedc9bd4b558&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:15.373851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61acb33-2c9a-43b9-bc21-2380c34a8020 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.374128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61acb33-2c9a-43b9-bc21-2380c34a8020 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.374397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61acb33-2c9a-43b9-bc21-2380c34a8020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.393996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a61acb33-2c9a-43b9-bc21-2380c34a8020 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:15.395211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a61acb33-2c9a-43b9-bc21-2380c34a8020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:15.395947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.396936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.397782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.398372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.400508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:15.401112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:15.402819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:15.433668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 289/568] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:15.434599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:15.488566 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:15.512662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 280/569] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:15.516160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61acb33-2c9a-43b9-bc21-2380c34a8020 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:15.565815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bfca5-3295-4c4b-b689-bf0fc0d49214 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.568943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:15.619874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.620892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.621785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.622263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.639309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:15.644830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61acb33-2c9a-43b9-bc21-2380c34a8020 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:15.645889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:15.646798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:15.647676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:15.648814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 290/570] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:15.655100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:15.690132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.690683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.691012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.691644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.706803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:15.709289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:15.729453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:15.731736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:15.733223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:15.733223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:15.733223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:15.735953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 281/571] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:15.737389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:15.803115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:15.807655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7d131-47db-470f-a24e-30beb9d83b46 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.849268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.850202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.850480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.850746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.852989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:15.864003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:15.867448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830a6da-9fb6-4445-a2cf-f10216bb5fb6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:15.869659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:15.870607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:15.871948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 291/572] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:15.873566 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:15.917862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:15.918486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:15.918764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:15.919032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:15.920194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:15.921066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:15.921942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:15.932684 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 282/573] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:15.933705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.005268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0dc5a-5c84-44aa-a47c-4b64f95a1085 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.044461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.045078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.045350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.045632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.046253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:16.046855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.048013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.056420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ebad8-82cf-49fb-bf9f-93560f9708aa None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.064679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 292/574] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:16.064679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.085748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.095289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.095970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.096253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.096790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.107952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:16.113199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:16.114131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:16.114977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 283/575] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:16.115718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.129042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.178377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267829e3-bbc9-427b-a3a2-d1fff8fdc9bf None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.215118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.215756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.216165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.216437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.217139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:16.217490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.218846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.222789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85349e-5b86-4b02-9a51-6ab73673fb9d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.229837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 293/576] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:16.230706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.265652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.266201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.266518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.266750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.277633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.279328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:16.294910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:16.296142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:16.297019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:16.297019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:16.297019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:16.301174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 284/577] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:16.302201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.329864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.349465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b66f30-13be-484b-92d0-67143d65727b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.371117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.383759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.385064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.385064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.385064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.391789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.393256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:16.404306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:16.405178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:16.406043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 294/578] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:16.406518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.421367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4dd5c-c586-48ff-b7b1-04d506064f8a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.456087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.456698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.456976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.457254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.457923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:16.458233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.459642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.471577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 285/579] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:16.471577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.511455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc5a7a-4979-4632-b7af-032450b3060a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.546174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.546733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.547013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.547281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.558531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.560732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.562325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.575894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e14a72-6b86-4240-a8b6-eeb228b53912 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:16.579933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:16.580896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:16.581868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:16.581868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:16.581868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:16.581868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 295/580] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:16.581868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.606437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.621079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.621776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.622116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.622503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.623373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:16.623761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.625141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.638273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 286/581] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:16.639173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.695350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7bd6cd-dcc6-4521-8672-7de93e0f3d94 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.729575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.730238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.730515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.730838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.732056 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:16.732364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.734104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.744562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aea911-c2e8-4c7d-a11a-27d006ce03b9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.746447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 296/582] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:16.747076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.784826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.785456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.785735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.785997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.795887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.797396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.805108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:16.812716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:16.814026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:16.814924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:16.814924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:16.814924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:16.814924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 287/583] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:16.814924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.852878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:16.857118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c1d50-6105-4921-b351-6c4b2dbd3de4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.893020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.893630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.893905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.894170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.894959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:16.895261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.897496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.915646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 297/584] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:16.915646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:16.926852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7fb7-f4ed-4e0e-87c1-e747e86c2ae0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:16.963152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:16.964181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:16.964460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:16.964982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:16.974780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:16.976868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:16.989743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:16.990699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 288/585] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:16.997119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.024356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c88b9-0e79-420c-a375-167d97a07e64 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.037858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.062027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.062617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.062906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.063567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/291c79a765764420a4b836c478c385b6/roles/1ab617a329104fd79ddc9e4476562ada` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.079688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=291c79a765764420a4b836c478c385b6, role_id=1ab617a329104fd79ddc9e4476562ada)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.081240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.089975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.096447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 298/586] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:16 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/291c79a765764420a4b836c478c385b6/roles/1ab617a329104fd79ddc9e4476562ada => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:17.097287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.097991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7cb97a-68b6-4db6-9ded-c986bd7a21b5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.157642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.159213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.159714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.160414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.161461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:17.162317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.164473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.183032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 289/587] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:17.184615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.206060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2c586-702f-448a-b7ca-fb5672c506f7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.244058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.245015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.245470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.245914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.254406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.256078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:17.269310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:17.270528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:16:17.271725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:17.278054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 299/588] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:17.279403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.311890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.331613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de8325-635f-4089-b80c-7e260823a689 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.377480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.378153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.378438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.378712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.379455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:17.379793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.381759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.406446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 290/589] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:17.407384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.415435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fcb36-3d99-4728-8363-c04761acf514 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.429472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.457593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.459041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.459333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.459637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.469270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.470858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:17.485807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:17.486820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:16:17.487803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:17.491966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 300/590] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:17.492724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.546999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730348c-7c44-411e-a7a2-b3ba67082733 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.590331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.591144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.591710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.591996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.592804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:17.593119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.594937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.599632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.619526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 291/591] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:17.620396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.627043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357dbd83-6bc8-48e8-9a66-636d5843b5b8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.666087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf6340-0ed8-48ac-8886-3656b7a9e456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.666724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6340-0ed8-48ac-8886-3656b7a9e456 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.666981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6340-0ed8-48ac-8886-3656b7a9e456 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.667248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf6340-0ed8-48ac-8886-3656b7a9e456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.679332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6340-0ed8-48ac-8886-3656b7a9e456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.680832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf6340-0ed8-48ac-8886-3656b7a9e456 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0abf6340-0ed8-48ac-8886-3656b7a9e456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:17.696650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:17.697633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:17.698518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:17.698518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:17.698518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:17.698518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 301/592] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:17.699281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e30ba-8399-4b98-a70b-e0e48e8f4b7b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.699281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e30ba-8399-4b98-a70b-e0e48e8f4b7b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.699451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e30ba-8399-4b98-a70b-e0e48e8f4b7b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.704164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 302/593] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:17.704164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e30ba-8399-4b98-a70b-e0e48e8f4b7b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.709497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.743434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c20d19-e04e-4459-bb2a-b6094b049c88 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.780501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.781136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.781402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.781678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.782689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:17.782689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.784170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.806060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 292/594] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:17.806060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.822597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e30ba-8399-4b98-a70b-e0e48e8f4b7b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.857933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd69ea8-0bd6-4050-a9f8-2644a38c329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.858489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69ea8-0bd6-4050-a9f8-2644a38c329e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.858768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69ea8-0bd6-4050-a9f8-2644a38c329e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.859038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd69ea8-0bd6-4050-a9f8-2644a38c329e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.860964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.871086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd69ea8-0bd6-4050-a9f8-2644a38c329e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.872646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd69ea8-0bd6-4050-a9f8-2644a38c329e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-4bd69ea8-0bd6-4050-a9f8-2644a38c329e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:17.888114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:17.889134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:17.895447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:17.895447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:17.895447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:17.895447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 303/595] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:17.895447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b77b3-2a07-479f-8261-f2e572870de0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.895447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b77b3-2a07-479f-8261-f2e572870de0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.895447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b77b3-2a07-479f-8261-f2e572870de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.910241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4e4b77b3-2a07-479f-8261-f2e572870de0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:17.911433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4e4b77b3-2a07-479f-8261-f2e572870de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:17.924001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543d6ba-4112-4532-989b-f7a9151153b9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:17.954958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:17.962341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:17.962959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:17.963301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:17.963605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:17.964289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:17.964593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:17.966018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:17.982129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 293/596] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:17.982129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:17.986403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 304/597] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:17.991588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b77b3-2a07-479f-8261-f2e572870de0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.102433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c185556-9d75-4948-8bc8-4dd010921bea None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.107478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b77b3-2a07-479f-8261-f2e572870de0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.125262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.138497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.139138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.139420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.139729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.144586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.145194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.145475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.145746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.146396 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:18.146700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.148754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.151369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.152981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.161890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 305/598] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:18.162721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:18.172777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:18.173789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:18.174810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:18.174810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:18.174810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:18.174810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 294/599] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:18.175054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.220232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.282040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91d135-bebf-46d4-9b70-243b15e8097e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.285021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a3ebb-a869-4353-8a39-e5730ca56106 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.318219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.319142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.319420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.319776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.321950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.322593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.322877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.323148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.327038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.328505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.330578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.332355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:18.339521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:18.340469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:18.341564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:18.342766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 306/600] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:18.343815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:18.344374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:18.345600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:18.346625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:18.350103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 295/601] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:18.350941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.386466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.453484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc6bf5-0cc3-4803-9c11-aa85d388b304 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.454718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852054bb-4b2f-4a49-b652-f3738985deff None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.456617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.489159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.489770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.490051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.490326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.490973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:18.491145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.491266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.491812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.492093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.492367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.492664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.502658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:18.509454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 307/602] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:18.509454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:18.509716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:18.510803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 296/603] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:18.511879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.611496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.617243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2ec81-5159-4741-a100-501612f77dcc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.619754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602991f7-8236-4705-89f7-03d59658b39b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.651691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.652233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.652517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.652793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.653581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:18.654002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.655513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.659852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.660675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.661128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.661589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.662448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:18.662933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.664546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.668749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 297/604] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:18.669577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.680096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 308/605] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:18.680983 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.702673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.783274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392ecc-6034-480c-9b11-fbd6b110bbda None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.793539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdd0fd-8ab9-41f6-aabe-c5eb9e6c311a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.824518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.825163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.825611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.825949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.830955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.831592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.831877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.832156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:18.832812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:18.833063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.833173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:18.834482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.834585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:18.842953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 309/606] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:18.843694 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:18.848895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:18.849780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 298/607] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:18.856200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:18.865391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.946027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:18.955277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002772fe-4e07-4bb3-8801-642e2fa94965 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.967894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168edfc-5f04-400a-864c-f60c234258ef None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:18.993288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:18.994369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:18.994747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:18.995116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/1d78fc219a25457ca11e38930b03e8ea/roles/1ab617a329104fd79ddc9e4476562ada` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.005932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:19.006714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.006997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.007502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/262c0977be384e59a37ef91978012ad6/roles/1ab617a329104fd79ddc9e4476562ada` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.011257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=1d78fc219a25457ca11e38930b03e8ea, role_id=1ab617a329104fd79ddc9e4476562ada)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:19.012899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:19.023786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=262c0977be384e59a37ef91978012ad6, role_id=1ab617a329104fd79ddc9e4476562ada)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:19.025485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:19.029717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 310/608] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:18 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/1d78fc219a25457ca11e38930b03e8ea/roles/1ab617a329104fd79ddc9e4476562ada => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:19.030671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:19.047612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 299/609] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:18 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/262c0977be384e59a37ef91978012ad6/roles/1ab617a329104fd79ddc9e4476562ada => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:19.047612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:19.182660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:19.253773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9badd4-f60b-48e6-9a8e-8e631bbdcc33 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:19.276180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2549e0d-49d5-4749-b9b9-841d270731d4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:19.322679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cf462-b863-4028-9e07-92af09e39b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:19.323336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf462-b863-4028-9e07-92af09e39b1a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.323687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf462-b863-4028-9e07-92af09e39b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.323966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf462-b863-4028-9e07-92af09e39b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.335033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:19.338767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cf462-b863-4028-9e07-92af09e39b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:19.340255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cf462-b863-4028-9e07-92af09e39b1a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:19.341236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849d1956-8d07-4392-8e32-7b0a6da98221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:19.342040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1956-8d07-4392-8e32-7b0a6da98221 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.342593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1956-8d07-4392-8e32-7b0a6da98221 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.343021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849d1956-8d07-4392-8e32-7b0a6da98221 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.344751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d1956-8d07-4392-8e32-7b0a6da98221 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:19.345426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d1956-8d07-4392-8e32-7b0a6da98221 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:19.347138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849d1956-8d07-4392-8e32-7b0a6da98221 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0b7cf462-b863-4028-9e07-92af09e39b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:19.358905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:19.360194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:19.361411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:19.361411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:19.361411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:19.361411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 311/610] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:19.361752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f36f-c86d-49fc-abb3-e5bc5bea097a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.361844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f36f-c86d-49fc-abb3-e5bc5bea097a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.362124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634f36f-c86d-49fc-abb3-e5bc5bea097a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.363422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 312/611] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:19.365495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 300/612] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:19.365944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634f36f-c86d-49fc-abb3-e5bc5bea097a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:19.368805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a4343-aaa5-4d66-90bc-fb4a50ae4cf6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.369265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a4343-aaa5-4d66-90bc-fb4a50ae4cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.369685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a4343-aaa5-4d66-90bc-fb4a50ae4cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.392560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f39a4343-aaa5-4d66-90bc-fb4a50ae4cf6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:19.393989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f39a4343-aaa5-4d66-90bc-fb4a50ae4cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:19.489212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634f36f-c86d-49fc-abb3-e5bc5bea097a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:19.490878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 301/613] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:16:19.491892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a4343-aaa5-4d66-90bc-fb4a50ae4cf6 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:19.536046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:19.553582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:19.555571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.556084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.557585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.558424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:19.560500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:19.564007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:19.586956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 313/614] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:19.590849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:19.677426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a4343-aaa5-4d66-90bc-fb4a50ae4cf6 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:19.716660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:19.721188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950135-067b-44d9-b3db-ba897172a207 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:19.749531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:19.749883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.750159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.750422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/de2913a65aac4fda97bc92dbf15d3316/roles/1ab617a329104fd79ddc9e4476562ada` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.765944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:19.766918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:19.767373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:19.768212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:19.783181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:19.784240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=de2913a65aac4fda97bc92dbf15d3316, role_id=1ab617a329104fd79ddc9e4476562ada)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:19.785921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:19.787655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:19.803946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:19.804991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:19.805978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:19.808905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 314/615] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:19.810333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:19.819312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 302/616] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:19 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/de2913a65aac4fda97bc92dbf15d3316/roles/1ab617a329104fd79ddc9e4476562ada => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:19.819312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:19.916194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:20.022904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134f344-d743-406d-8452-e28d760c6356 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.050405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976605a-a98e-4a01-a816-ab52a6cc973b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.086044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.087301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.087915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.088478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.089480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:20.090094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:20.090676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.091392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.091731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.092006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.093059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:20.104279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:20.112028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:20.113034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:20.113870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:20.118007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 315/617] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:20.119231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 303/618] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 05:16:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:20.119427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:20.125380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:20.171113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:20.238036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:20.240383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35488b-8b02-4e29-920b-f4c2af67edcb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.275385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.276425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.276736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.277011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.280650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:20.280650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:20.280650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:20.295676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 316/619] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:20.297115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:20.300958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcebb62-0a93-4f63-abbc-dc8821bd3983 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.369836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.370840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.371320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.375922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.393399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:20.395346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:20.402319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c43ca-70de-4c74-953a-7517ec3583e1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:20.420266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:20.421288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:20.422207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:20.422207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:20.422207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:20.429878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 304/620] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:20.431502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:20.439988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.440509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.440789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.441060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.461230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:20.462693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:20.488666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:20.489712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:20.490630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:20.490630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:20.490630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:20.490630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 317/621] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:20.500572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:20.530191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:20.598900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:20.635005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841125a-0db7-48e0-b0fe-179498677c57 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.639745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad393908-7aba-4e52-b684-da705d003f7a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.677028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.677637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.677916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.678184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.678825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:20.679124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:20.680534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:20.695488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 318/622] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:20.708142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:20.715171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.716341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.716828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.717302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.718377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:20.718908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:20.721188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:20.737542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 305/623] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:20.743504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:20.858123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:20.898265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad774e-41bf-4d38-aa73-3676e443923f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.947199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75707f7e-ad33-43dd-ac53-63ddec5d5b27 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:20.971884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:20.972880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:20.973377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:20.973841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:20.987172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:20.989345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:21.009517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:21.010604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:21.011586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:21.016940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 319/624] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:16:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:21.023071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:21.029843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:21.030493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.030764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.031031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.043847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:21.045503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:21.081231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:21.082228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:21.083112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:21.084193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 306/625] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:21.089486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:21.095258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:21.239417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ee948-e9c2-4c5f-b61e-a1c0a604af1f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:21.292014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483cb6cc-348c-4158-9481-670ada46a794 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:21.307764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:21.308376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.308649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.308912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.309955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:21.312064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:21.313775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:21.316825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:21.359579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 320/626] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:16:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:21.368621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:21.379978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:21.380951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.381437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.381909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.382805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:21.383329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:21.385075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:21.412332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 307/627] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:21.414484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:21.557215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:21.571953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd08ae-a199-404d-8cbe-87f5ac785d2d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:21.610340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8a0a2-796e-40f1-b9b9-d866ec737670 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:21.612189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ac592-380b-458e-9813-9ab19b65223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:21.613892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ac592-380b-458e-9813-9ab19b65223a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.614380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ac592-380b-458e-9813-9ab19b65223a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.614850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ac592-380b-458e-9813-9ab19b65223a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.654655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93cd73d-0d77-472f-9d39-010b875a63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:21.655337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cd73d-0d77-472f-9d39-010b875a63b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.655641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cd73d-0d77-472f-9d39-010b875a63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.655911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93cd73d-0d77-472f-9d39-010b875a63b9 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/4f85a6800f914551b065fedc9bd4b558/roles/1ab617a329104fd79ddc9e4476562ada` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.676498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cd73d-0d77-472f-9d39-010b875a63b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=4f85a6800f914551b065fedc9bd4b558, role_id=1ab617a329104fd79ddc9e4476562ada)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:21.677955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93cd73d-0d77-472f-9d39-010b875a63b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:21.680919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:21.692570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ac592-380b-458e-9813-9ab19b65223a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:21.694019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ac592-380b-458e-9813-9ab19b65223a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:21.695742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 308/628] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:21 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/4f85a6800f914551b065fedc9bd4b558/roles/1ab617a329104fd79ddc9e4476562ada => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:21.705092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5349a-6ba4-4c63-a7c8-0060fa500cac None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.705436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5349a-6ba4-4c63-a7c8-0060fa500cac None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.705648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5349a-6ba4-4c63-a7c8-0060fa500cac None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.711599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 309/629] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:21.711599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb99e-fd39-45f6-afd2-767b924f3950 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.711599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb99e-fd39-45f6-afd2-767b924f3950 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.711599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebb99e-fd39-45f6-afd2-767b924f3950 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.711599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 310/630] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:21.721406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b895c-3e5e-4cd1-813e-0ae8ece8bc91 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.722055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b895c-3e5e-4cd1-813e-0ae8ece8bc91 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.722055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b895c-3e5e-4cd1-813e-0ae8ece8bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.741711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2a4b895c-3e5e-4cd1-813e-0ae8ece8bc91 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:21.742956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2a4b895c-3e5e-4cd1-813e-0ae8ece8bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:21.817274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 321/631] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:21.818747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ebf3-91aa-4293-b36b-c834fba6fca7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:21.819032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ebf3-91aa-4293-b36b-c834fba6fca7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:21.819315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ebf3-91aa-4293-b36b-c834fba6fca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:21.841815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9942ebf3-91aa-4293-b36b-c834fba6fca7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:21.851579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 311/632] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:21.851579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b895c-3e5e-4cd1-813e-0ae8ece8bc91 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:21.851892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9942ebf3-91aa-4293-b36b-c834fba6fca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:21.930969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:21.969339 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 322/633] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:22.003087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b895c-3e5e-4cd1-813e-0ae8ece8bc91 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.038054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.038697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.038978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.039253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.053450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:22.054922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:22.082695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:22.083839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:22.084870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:22.084870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:22.084870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:22.084870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 312/634] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:22.090649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ebf3-91aa-4293-b36b-c834fba6fca7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.139618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:22.199723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.252143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ebf3-91aa-4293-b36b-c834fba6fca7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.306187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.306508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.306784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.307051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.307732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:22.308034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:22.309417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:22.322423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 323/635] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:22.323266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.333413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:22.341251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9804-b674-4c8f-b656-dccbe0e87f07 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.382474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.383399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.383961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.384391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.396499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:22.402214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:22.403375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:22.404376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:22.406715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 313/636] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:22.407785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.422034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:22.447720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f43af-0f60-45ec-83d0-63a2b7934252 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.489379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.490016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.490288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.490560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.501067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:22.507252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:22.508229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 324/637] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:22.514454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.537269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cada92-984b-4022-9bba-9a0f616728c9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.573461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd9cb-03c9-4bef-ae21-7bbea10acb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.574085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd9cb-03c9-4bef-ae21-7bbea10acb27 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.574352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd9cb-03c9-4bef-ae21-7bbea10acb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.574629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd9cb-03c9-4bef-ae21-7bbea10acb27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.582414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd9cb-03c9-4bef-ae21-7bbea10acb27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:22.583928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cd9cb-03c9-4bef-ae21-7bbea10acb27 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a86cd9cb-03c9-4bef-ae21-7bbea10acb27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:22.595228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:22.596169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:22.597060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 314/638] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:22.598192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2faeed-0c56-4f54-8874-9c2e263f24ba None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.598192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2faeed-0c56-4f54-8874-9c2e263f24ba None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.598192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2faeed-0c56-4f54-8874-9c2e263f24ba None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.603762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 315/639] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:22.603762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2faeed-0c56-4f54-8874-9c2e263f24ba None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.619800 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:22.628646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce9f37-2df1-428d-a07e-8fdd636a162d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.666340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.666952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.667227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.667492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.668181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:22.668478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:22.669940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:22.678732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 325/640] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:22.679726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.684893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:22.721404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2faeed-0c56-4f54-8874-9c2e263f24ba None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.756474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032124ef-c23a-4964-8dbb-820a12b9c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.757140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032124ef-c23a-4964-8dbb-820a12b9c39a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.757348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032124ef-c23a-4964-8dbb-820a12b9c39a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.757622 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032124ef-c23a-4964-8dbb-820a12b9c39a None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.758283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032124ef-c23a-4964-8dbb-820a12b9c39a None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:22.758586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032124ef-c23a-4964-8dbb-820a12b9c39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:22.760000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032124ef-c23a-4964-8dbb-820a12b9c39a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:22.768347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 316/641] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:22.769531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b12d-486d-4538-af12-7a6962ddaefc None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.769813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b12d-486d-4538-af12-7a6962ddaefc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.770085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b12d-486d-4538-af12-7a6962ddaefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.788416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8051b12d-486d-4538-af12-7a6962ddaefc None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:22.789656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8051b12d-486d-4538-af12-7a6962ddaefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:22.799102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c68c50-4f93-45b6-a353-964028dc9836 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.837368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:22.838359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:22.838922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:22.839404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:22.840339 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:22.840845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:22.842643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:22.855749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 326/642] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:22.856744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.864358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 317/643] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:22.865364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b12d-486d-4538-af12-7a6962ddaefc None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:22.878457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:22.937809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:22.986650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b12d-486d-4538-af12-7a6962ddaefc None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:22.988940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e85b6-27c5-495e-9a79-cfbc2c607cda None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.024540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.025423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.025843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.026280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.033617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.034823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.035166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.035500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.038406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.040093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.047595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.049599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:23.057525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:23.058755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:23.060160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:23.060160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:23.060160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:23.062370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 318/644] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:23.063806 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:23.069472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:23.070614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:23.071935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:23.071935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:23.071935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:23.073094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 327/645] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:23.074054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.144050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:23.189341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2eb91-593e-4c3c-8ec3-6413fc841217 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.190672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80873-ad1c-4d62-8cd8-91c7afe5eca7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.205958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:23.225978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.226585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.226862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.227130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.227915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=291c79a765764420a4b836c478c385b6) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:23.228185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.229140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.229627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.229875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.230219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.230555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.231372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:23.231912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.233479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.243856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 319/646] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/role_assignments?user.id=291c79a765764420a4b836c478c385b6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:23.243856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.258767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 328/647] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:23.259841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.355721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8be9-abfc-4da6-af68-8264b4487d42 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.392054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:23.406437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.407387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.407841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.408249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.409037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:23.409498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.411038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.422334 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de076f2f-4f65-4cc2-9ba0-f2d265356327 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.430232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 320/648] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:23.431473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.492541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.492541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.492541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.492896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.506218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:23.511316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:23.512311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:23.513264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:23.522485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 329/649] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:23.523706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.590535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4bb0f-43d7-40cc-9cba-c4eb44df978e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.626329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.626966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.627243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.627512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.635405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.637131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:23.638810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:23.651636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:23.652819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:16:23.654030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:23.656092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 321/650] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:23.657120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.725462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:23.760695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811eb620-1790-4633-ac53-eac7288ee1b3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.820425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.821263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.821654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.822250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.830289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.831885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:23.844592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:23.845791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:16:23.846959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:23.853871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 330/651] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:23.854975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:23.862323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d49512-5f18-4ace-ba74-bbf5a335ee26 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:23.926506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:23.927479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:23.927924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:23.928361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:23.929432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:23.929888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:23.932547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:23.944153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 322/652] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:23.945221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.006973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.013947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9bbd-d934-4550-a148-1845e1316a13 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.056857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.057633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.058002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.058364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.059778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:24.060194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.062153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.072037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5f15e-c950-479e-a179-0b5f0ce9b35c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.075568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.087688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 331/653] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:24.088787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.120119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.121093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.121498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.121859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.123394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:24.123826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.125893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.146863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 323/654] 10.222.0.18 () {56 vars in 1137 bytes} [Mon Sep 26 05:16:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:24.147874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.200590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01801f-1c63-458b-9644-0876f8c6d2ff None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.236258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ed7d2-827f-4a72-83b6-8d3e799c90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.237213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed7d2-827f-4a72-83b6-8d3e799c90fa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.237631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed7d2-827f-4a72-83b6-8d3e799c90fa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.237904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ed7d2-827f-4a72-83b6-8d3e799c90fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.244843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbfa7a-d90d-45a3-9ae3-b87857b288d1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.248647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ed7d2-827f-4a72-83b6-8d3e799c90fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.250094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ed7d2-827f-4a72-83b6-8d3e799c90fa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-7c5ed7d2-827f-4a72-83b6-8d3e799c90fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:24.264921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:24.265950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:24.266833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:24.266833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:24.266833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:24.266833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 332/655] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:24.267591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217032-5231-41cd-855b-73a27d04e582 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.267591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217032-5231-41cd-855b-73a27d04e582 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.267817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee217032-5231-41cd-855b-73a27d04e582 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.271657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 333/656] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:24.271657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217032-5231-41cd-855b-73a27d04e582 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.287212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.297584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.297584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.297584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.297584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.330081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.370276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.371966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.380615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee217032-5231-41cd-855b-73a27d04e582 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.413708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270e320-6a7e-49be-ad6b-74034f67c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.414314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e320-6a7e-49be-ad6b-74034f67c642 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.414588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e320-6a7e-49be-ad6b-74034f67c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.414855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270e320-6a7e-49be-ad6b-74034f67c642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.478894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 324/657] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:24.479734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.481151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270e320-6a7e-49be-ad6b-74034f67c642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.482651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270e320-6a7e-49be-ad6b-74034f67c642 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.490295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.541899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.583497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc941c-be17-4f55-8be8-3c656f8b2939 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.605484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 334/658] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:24.605484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a0c04-9020-41f3-ab30-594f8c587df6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.605484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a0c04-9020-41f3-ab30-594f8c587df6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.605484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a0c04-9020-41f3-ab30-594f8c587df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.622504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b55a0c04-9020-41f3-ab30-594f8c587df6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:24.623752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b55a0c04-9020-41f3-ab30-594f8c587df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:24.625871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.626722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.627064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.627406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.628148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:24.628455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.629822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.647016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 325/659] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:24.647016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.696771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 335/660] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:24.697532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a0c04-9020-41f3-ab30-594f8c587df6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.734474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.790519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de779d47-2a65-4f0d-9fa2-437c4b5927e0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.808969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a0c04-9020-41f3-ab30-594f8c587df6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:24.820654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:24.836921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446dae-e02f-47c8-9855-f250904845be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.838060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446dae-e02f-47c8-9855-f250904845be None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.838542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446dae-e02f-47c8-9855-f250904845be None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.839331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446dae-e02f-47c8-9855-f250904845be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.847142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:24.847798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:24.848075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:24.848343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:24.853742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446dae-e02f-47c8-9855-f250904845be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.855900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56446dae-e02f-47c8-9855-f250904845be None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.864543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:24.867378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-56446dae-e02f-47c8-9855-f250904845be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:24.873837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:24.875177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:24.876084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:24.876084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:24.876084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:24.879824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 326/661] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:24.880986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446dae-e02f-47c8-9855-f250904845be None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:24.889238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:24.890194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:24.891102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:24.891102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:24.891102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:24.893822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 336/662] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:24.894804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:24.993750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446dae-e02f-47c8-9855-f250904845be None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.002387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.016293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990018e-38d5-46f2-a3a8-ccddc962fa0e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.030240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.030886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.031168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.031440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.039350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.040867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.051807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:25.052131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:25.053143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 327/663] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:25.054092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.055813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.056093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.056362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.057013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:25.057311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.058879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.074457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 337/664] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:25.075803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.095947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.165032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4fd6f-8fb7-4f05-aeca-a0599e12abed None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.182039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2c37f-fc6c-410d-8f84-825fb669fb4c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.200600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.201219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.201501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.201773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.202421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:25.202726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.204149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.220842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 328/665] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:25.220842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.225253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.225979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.226331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.226674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.239430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:25.245340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:25.246458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 338/666] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:25.247672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.259775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.331759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.339040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a0fb2-3b24-49d8-9f88-a8fe8a5243ac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.354454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6774e10-3f8e-46e8-b8dd-2fb7064f11b7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.374174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.374918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.375317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.375733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.376570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:25.376974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.378515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.390405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.391034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.391309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.391600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.397200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 329/667] 10.222.0.18 () {56 vars in 1139 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:25.398342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.399237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.400816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:25.412601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:25.413674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:25.414788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:25.421400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 339/668] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:25.421400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.493910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.514219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff7a94-6042-4262-a318-c4a62676df0d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.531226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b9565-c4ad-47ee-9d66-01bb111dc12e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.547320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.548002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.548283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.548561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.555391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.556887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.567806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:25.568344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:25.569240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:25.570121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 330/669] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:25.570605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.571197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.571476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.571777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.572459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:25.572765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.574126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.582628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 340/670] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:25.583446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.591007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.675405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3e53-fe0b-40bc-8f09-dbc16b3bf05c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.679378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf132e-e291-48b8-9245-4f62dbd906d6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.710844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.714070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.714692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.714970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.715238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.717115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.717723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.718027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.718297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.719025 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:25.719332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.720815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.733158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 341/671] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:25.733773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.788278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.789687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.803405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.831948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1537b-147c-4090-8762-729fbc69df2e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.866060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc517264-acbf-404e-8ca2-1bf28a52ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:25.866664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517264-acbf-404e-8ca2-1bf28a52ac89 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.866941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517264-acbf-404e-8ca2-1bf28a52ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.867209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc517264-acbf-404e-8ca2-1bf28a52ac89 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.867921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc517264-acbf-404e-8ca2-1bf28a52ac89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:25.868228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc517264-acbf-404e-8ca2-1bf28a52ac89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:25.869656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc517264-acbf-404e-8ca2-1bf28a52ac89 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:25.881477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 342/672] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:25.882764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e321-bb01-4806-bd2b-2709a49c8920 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:25.883051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e321-bb01-4806-bd2b-2709a49c8920 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:25.883370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e321-bb01-4806-bd2b-2709a49c8920 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:25.884650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 343/673] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:25.885348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e321-bb01-4806-bd2b-2709a49c8920 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.894074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 331/674] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:25.895475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:25.941872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:25.992994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e321-bb01-4806-bd2b-2709a49c8920 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:25.995729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e99c-c5c6-4330-87e6-a0a5d0a31ad4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.008565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:26.030618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db24c30-ebf5-44a4-b4fb-3930b678fd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.031245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db24c30-ebf5-44a4-b4fb-3930b678fd51 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.031432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.031580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db24c30-ebf5-44a4-b4fb-3930b678fd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.031806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db24c30-ebf5-44a4-b4fb-3930b678fd51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.032056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.032339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.032612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.033337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=1d78fc219a25457ca11e38930b03e8ea) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:26.033649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.035083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.040835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 332/675] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/role_assignments?user.id=1d78fc219a25457ca11e38930b03e8ea&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:26.041551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.042156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db24c30-ebf5-44a4-b4fb-3930b678fd51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.043608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db24c30-ebf5-44a4-b4fb-3930b678fd51 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-2db24c30-ebf5-44a4-b4fb-3930b678fd51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:26.058601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:26.059930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:26.060897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:26.060897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:26.060897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:26.060897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 344/676] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:26.061676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae46f-0f61-47b8-913d-9d3e166a1d11 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.061955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae46f-0f61-47b8-913d-9d3e166a1d11 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.062223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ae46f-0f61-47b8-913d-9d3e166a1d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.082500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-387ae46f-0f61-47b8-913d-9d3e166a1d11 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:26.083794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-387ae46f-0f61-47b8-913d-9d3e166a1d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:26.169007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7f18b-333f-44d2-bfad-cbf1c2a2e7da None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.171697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 345/677] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:26.172674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ae46f-0f61-47b8-913d-9d3e166a1d11 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.213648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:26.223941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.224563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.224844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.225118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.225854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=262c0977be384e59a37ef91978012ad6) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:26.226166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.227640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.236133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 333/678] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/role_assignments?user.id=262c0977be384e59a37ef91978012ad6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:26.236811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.309545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:26.320630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ae46f-0f61-47b8-913d-9d3e166a1d11 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.366949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.367912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.368360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.368804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.383830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.385802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.394953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5338012-48c4-4f5c-9881-ec7fd1f3e288 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:26.404166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:26.405313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:26.406214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:26.406214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:26.406214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:26.406214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 346/679] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:26.414807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.442319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.443747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.444199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.444925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.445608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:26.445918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.448139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.466317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 334/680] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:26.472338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.522352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:26.544998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a95b7-ba61-4314-8f69-4f5a5128ed68 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.580003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.580671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.581051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.581455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.582211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:26.582613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.584112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.597538 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 347/681] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:26.598597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.600472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:26.604566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78367f73-ad9c-44f7-ad04-b12c10419c3c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.642981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.644675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.645055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.645428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.654785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.656705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:26.673049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:26.674018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:26.674942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:26.675587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 335/682] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:26.676533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.724656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df189db3-2da4-42a8-811a-4d378bcc54db None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.765768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.766409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.766683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.766964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.778376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:26.783215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:26.784177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:26.785008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 348/683] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:26.785696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.791752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:26.820137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8208ad9-a06f-4785-9147-068418726c63 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.858467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.859483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.859983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.860441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.868098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.869812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:26.882449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:26.884752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:26.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:26.891375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 336/684] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:26.892557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.898418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0528492-ddb3-4a38-b295-13af6cf47d13 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:26.916001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:26.935650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:26.936525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:26.936663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:26.936824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:26.937676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:26.938480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:26.940132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:26.963891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 349/685] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:26.964835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:26.997308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521cfae-0af9-4d40-8532-c016cec7aa59 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.027385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:27.035788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.037041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.037527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.037977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.038824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:27.039300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.040877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.055477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 337/686] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:27.056680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.068372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe5968-7d4f-4509-9262-7216d9a12f13 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.105306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.105923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.106195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.106583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.107280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:27.107782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.109343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.127405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 350/687] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:27.127405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.152307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:27.172186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e8759-8958-412f-844a-5691aaae65cb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.208981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.209727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.210107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.210793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.238225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57898d01-fe6c-4baa-9113-7e09dceb09ac None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.276724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:27.288318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.290739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.304005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.305104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.305559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.306119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.321153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.323087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:27.342106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:27.343135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:27.344088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:27.344088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:27.344088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:27.345951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 351/688] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:27.346867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.381024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:27.405764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 338/689] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:27.405764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.458511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb352490-efbd-423c-9a24-c7147eb69627 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.494515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.495393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.495922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.496367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.497402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=de2913a65aac4fda97bc92dbf15d3316) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:27.497848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.499668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.505376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb40ff-b13c-4a58-abe6-3cf5b9c5c38f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.506494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 352/690] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/role_assignments?user.id=de2913a65aac4fda97bc92dbf15d3316&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:27.507480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.550693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:27.575629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.576285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.576563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.576831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.577480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:27.577780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.579358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.604121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 339/691] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:27.610013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.639350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3a01e-0540-43a6-bbb6-8a97a4cef941 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.679456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.680529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.681141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.681610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.694931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.696796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.703717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:27.740771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:27.741793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:27.742700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:27.742700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:27.742700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:27.745853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 353/692] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:27.753165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.827535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e835c672-220d-4068-af37-3bb8b1c3bac7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.865941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.866577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.866853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.867162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.868963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:27.876462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.878581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.880574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9bba3-ad2c-4e67-8858-c4518ef1ed3d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:27.891095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:27.892426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:27.893374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 340/693] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:27.898128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:27.921281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:27.922371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:27.922842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:27.923325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:27.924320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:27.924818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:27.926407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:27.942149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 354/694] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:27.949183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:28.011304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb317a-eb30-4e01-97c5-a6f79d48a0b5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:28.013202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:28.056570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:28.057195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.057471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.057737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.058613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:28.059046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:28.060833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:28.068035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807df00-676a-4d84-9244-323c382a9ac8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:28.084177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 341/695] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:28.090449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:28.114574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:28.116299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.116688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.117060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.125388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:28.127073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:28.150636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:28.151770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:28.152678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:28.156792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 355/696] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:28.163587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:28.176456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:28.240339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201b84-e9c2-4a2a-9d5f-55076a7f7d03 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:28.318399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:28.319025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.319306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.319602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.352051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5144641-ffa7-4873-8065-9e215ea04d9f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:28.374975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:28.419357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:28.419923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.420204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.420479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.421181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:28.421491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:28.422933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:28.441012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 356/697] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:28.447731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:28.449260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:28.449581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:28.536068 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:28.577128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a013465-c414-430d-af31-59e3d93017ae None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:28.615376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32070cdd-d6f3-4a3b-847e-b8bf170a52e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:28.616273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070cdd-d6f3-4a3b-847e-b8bf170a52e0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.616701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070cdd-d6f3-4a3b-847e-b8bf170a52e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.617120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32070cdd-d6f3-4a3b-847e-b8bf170a52e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.618024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32070cdd-d6f3-4a3b-847e-b8bf170a52e0 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=4f85a6800f914551b065fedc9bd4b558) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:28.618482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32070cdd-d6f3-4a3b-847e-b8bf170a52e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:28.620172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32070cdd-d6f3-4a3b-847e-b8bf170a52e0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:28.626863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 357/698] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:28 2022] GET /identity/v3/role_assignments?user.id=4f85a6800f914551b065fedc9bd4b558&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:28.636408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0254-e351-4d61-9ffa-5d66a320d573 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.636759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0254-e351-4d61-9ffa-5d66a320d573 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.636966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b0254-e351-4d61-9ffa-5d66a320d573 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.638818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 358/699] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:28.644564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a641e9-8b35-4190-8548-8e8ac3f22dbc None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.644862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a641e9-8b35-4190-8548-8e8ac3f22dbc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.645112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a641e9-8b35-4190-8548-8e8ac3f22dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.658408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 342/700] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:28.663569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:28.684811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-12a641e9-8b35-4190-8548-8e8ac3f22dbc None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:28.685964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-12a641e9-8b35-4190-8548-8e8ac3f22dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:28.728574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:28.777275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a32231-2326-4eeb-8632-bd5492ebae63 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:28.778862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 359/701] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:28.782001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a89a-3da3-4771-9389-cd2bf06bc6a2 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.782357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a89a-3da3-4771-9389-cd2bf06bc6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.782696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796a89a-3da3-4771-9389-cd2bf06bc6a2 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.787592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 360/702] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:28.798714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41093a7-1bde-418b-becc-c0ac6bda607c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.798714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41093a7-1bde-418b-becc-c0ac6bda607c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.798714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41093a7-1bde-418b-becc-c0ac6bda607c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.834343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e41093a7-1bde-418b-becc-c0ac6bda607c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:28.835610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e41093a7-1bde-418b-becc-c0ac6bda607c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:28.851917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:28.852638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:28.852922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:28.853193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:28.870074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:28.871890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:28.891802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:28.892967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:28.894027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:28.894027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:28.894027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:28.894027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 343/703] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:28.898712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:28.937309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:28.955570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 361/704] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:16:29.019750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a04be3-a3d6-49dd-a4e2-df95c5d0bf38 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.033479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:29.056704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.057310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.057586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.057853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.058543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:29.058844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.060372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.073506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 344/705] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:29.078729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41093a7-1bde-418b-becc-c0ac6bda607c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.099595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.194265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41093a7-1bde-418b-becc-c0ac6bda607c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.213452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d98b7-9d23-440a-982d-17915a1d6c10 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.233483 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.234132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.234413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.234686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.242060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.244346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.254696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.255337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.255641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.255907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.256492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:29.257265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:29.258128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:29.259460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:29.259937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.260009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 362/706] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:29.260009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:29.271239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:29.272605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:29.273670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:29.274746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 345/707] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:29.275518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.324153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:29.347603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:29.398274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5333f50-ec86-4dad-8707-1322b38cbace None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.420445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f5dbd-1a48-4b37-955c-f235fd02feef None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.445690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.446790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.447280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.447787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.448772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:29.449276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.451024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.464798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.465377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 346/708] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:29.465484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.465887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.466159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.467344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.478776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.480714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:29.500253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:29.501293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:29.502859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:29.502859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:29.502859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:29.506603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 363/709] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:29.507478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.579920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:29.584496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ab8ab-0d00-4352-affd-4c6bbf88b856 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.617883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136195-c5d5-43f3-8213-3bfc7c718bcc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.622689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.623366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.623680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.623946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.624573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:29.624874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.626249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.627672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:29.632301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 347/710] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:29.633353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.657926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.658845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.659163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.659531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.660410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=291c79a765764420a4b836c478c385b6) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:29.660812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.662340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.668791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 364/711] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/role_assignments?user.id=291c79a765764420a4b836c478c385b6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:29.669798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.751504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c549fc-cfbb-47d1-90ff-ebd60703f7d8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.782764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936392aa-52b6-4c96-8429-dc255dd27dca None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.791571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.792401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.792957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.793449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.795134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:29.795736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.797391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.812616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 348/712] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:29.818898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:29.821713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccc9c9-e24d-4f93-be85-00ab50dc5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.822449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc9c9-e24d-4f93-be85-00ab50dc5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.822630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc9c9-e24d-4f93-be85-00ab50dc5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.822890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccc9c9-e24d-4f93-be85-00ab50dc5ac8 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.823535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccc9c9-e24d-4f93-be85-00ab50dc5ac8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:29.823911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccc9c9-e24d-4f93-be85-00ab50dc5ac8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.825754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccc9c9-e24d-4f93-be85-00ab50dc5ac8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:29.832665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 365/713] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 05:16:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:29.848835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:29.947129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c710c0a6-8da7-4187-80b6-8ab5c004daa0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:29.987919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222795bc-d905-454e-89ed-ea72bd1fa100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:29.988988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222795bc-d905-454e-89ed-ea72bd1fa100 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:29.989418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222795bc-d905-454e-89ed-ea72bd1fa100 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:29.989862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222795bc-d905-454e-89ed-ea72bd1fa100 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:29.990668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222795bc-d905-454e-89ed-ea72bd1fa100 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:29.992281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222795bc-d905-454e-89ed-ea72bd1fa100 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:30.034532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 349/714] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:16:29 2022] POST /identity/v3/users => generated 254 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:16:30.334644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada9333-1b5c-40db-8080-252cc3f99709 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:30.335205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada9333-1b5c-40db-8080-252cc3f99709 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:30.335205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada9333-1b5c-40db-8080-252cc3f99709 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:30.336792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 366/715] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:30.342193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89677-28d6-44b7-b793-997cd8539c1d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:30.342476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89677-28d6-44b7-b793-997cd8539c1d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:30.342747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc89677-28d6-44b7-b793-997cd8539c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:30.361587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5dc89677-28d6-44b7-b793-997cd8539c1d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:30.362782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5dc89677-28d6-44b7-b793-997cd8539c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:30.436060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 350/716] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:30.709394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada9333-1b5c-40db-8080-252cc3f99709 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:30.747701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:30.822075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada9333-1b5c-40db-8080-252cc3f99709 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:30.872034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:30.872678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:30.872946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:30.873209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] PATH_INFO: `/v3/services/network` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:30.873791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:30.875154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:30.888814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:30.889878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:30.890711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 367/717] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:30 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:30.896120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89677-28d6-44b7-b793-997cd8539c1d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:30.906944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:31.056454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc89677-28d6-44b7-b793-997cd8539c1d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:31.103083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908c73e-eb5b-4658-89b5-f442c70b150c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:31.103721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908c73e-eb5b-4658-89b5-f442c70b150c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:31.104002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908c73e-eb5b-4658-89b5-f442c70b150c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:31.104271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908c73e-eb5b-4658-89b5-f442c70b150c None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:31.104902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908c73e-eb5b-4658-89b5-f442c70b150c None admin] RBAC: Adding query filter params (name=network) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:31.105205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908c73e-eb5b-4658-89b5-f442c70b150c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:31.106719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908c73e-eb5b-4658-89b5-f442c70b150c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:31.111260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 351/718] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:31.116871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:31.252567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:31.256438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f235e17-134e-424c-8116-08f4d4102018 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:31.291216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659dbc4-44a1-4d79-9c0b-fcef9dfd6c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:31.291887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659dbc4-44a1-4d79-9c0b-fcef9dfd6c7b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:31.292172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659dbc4-44a1-4d79-9c0b-fcef9dfd6c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:31.292438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659dbc4-44a1-4d79-9c0b-fcef9dfd6c7b None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:31.293069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659dbc4-44a1-4d79-9c0b-fcef9dfd6c7b None admin] RBAC: Adding query filter params (type=network) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:31.293365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659dbc4-44a1-4d79-9c0b-fcef9dfd6c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:31.294834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659dbc4-44a1-4d79-9c0b-fcef9dfd6c7b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:31.302614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 368/719] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:31.649908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9450f3-2523-4cd3-8583-70da055f97c0 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:31.650559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9450f3-2523-4cd3-8583-70da055f97c0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:31.651040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9450f3-2523-4cd3-8583-70da055f97c0 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:31.652883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 352/720] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:31.663589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d83e0-1120-4029-8116-9095b0502cbc None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:31.664114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d83e0-1120-4029-8116-9095b0502cbc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:31.664192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d83e0-1120-4029-8116-9095b0502cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:31.689695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f79d83e0-1120-4029-8116-9095b0502cbc None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:31.690905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f79d83e0-1120-4029-8116-9095b0502cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:31.774231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 369/721] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:32.186186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9450f3-2523-4cd3-8583-70da055f97c0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:32.232718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaec73-d980-41c2-b87c-8437fde48d16 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.233051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaec73-d980-41c2-b87c-8437fde48d16 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.233271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aaec73-d980-41c2-b87c-8437fde48d16 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:32.234868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 370/722] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:32.239957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c863dd8-a5b1-40ba-908b-6471da1d677f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.240237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c863dd8-a5b1-40ba-908b-6471da1d677f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.240505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c863dd8-a5b1-40ba-908b-6471da1d677f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:32.258942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0c863dd8-a5b1-40ba-908b-6471da1d677f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:32.260146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0c863dd8-a5b1-40ba-908b-6471da1d677f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:32.279887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:32.340740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9450f3-2523-4cd3-8583-70da055f97c0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:32.401557 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 371/723] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:32.409177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee1ba-0c2d-40f4-aa12-a221152a6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:32.409831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee1ba-0c2d-40f4-aa12-a221152a6f8d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.410107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee1ba-0c2d-40f4-aa12-a221152a6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.410374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee1ba-0c2d-40f4-aa12-a221152a6f8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:32.421230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee1ba-0c2d-40f4-aa12-a221152a6f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a0cee1ba-0c2d-40f4-aa12-a221152a6f8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:32.425935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:32.426920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:32.427793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 353/724] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:32.433068 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c863dd8-a5b1-40ba-908b-6471da1d677f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:32.479985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:32.586187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c863dd8-a5b1-40ba-908b-6471da1d677f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:32.599862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83d5db-2c54-4959-9725-993dae11b47d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.600159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83d5db-2c54-4959-9725-993dae11b47d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.600406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83d5db-2c54-4959-9725-993dae11b47d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:32.609092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 354/725] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:32.615333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acf62e-5ac9-42a5-a0fa-2ab97bdbafa1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.615853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acf62e-5ac9-42a5-a0fa-2ab97bdbafa1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.616384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acf62e-5ac9-42a5-a0fa-2ab97bdbafa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:32.635510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c6acf62e-5ac9-42a5-a0fa-2ab97bdbafa1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:32.637016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c6acf62e-5ac9-42a5-a0fa-2ab97bdbafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:32.643620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:32.644243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.644520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.644788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:32.645451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:32.645755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:32.647583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:32.664237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 372/726] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:32.670575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:32.739725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 355/727] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:32.747567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acf62e-5ac9-42a5-a0fa-2ab97bdbafa1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:32.811830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:32.838480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245fb7c-1ef2-4793-a9c3-de16ee1f995a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:32.848867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:32.903635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:32.904315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.904594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.904863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:32.919930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acf62e-5ac9-42a5-a0fa-2ab97bdbafa1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:32.923678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:32.925141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:32.949820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:32.951271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:32.952188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:32.952188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:32.952188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:32.952370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 373/728] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:32.958561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:32.985656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:32.986298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:32.986583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:32.986863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.002070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:33.007259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:33.008198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:33.009054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 356/729] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:33.019724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.111211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527d49-e515-4dd8-a66c-2abc113d057c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.146711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.146923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daca1b5-b601-40d7-be5b-4d62dd7cbd13 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.147806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.148350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.148810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.149639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:33.150141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:33.151845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:33.154746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:33.166582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 374/730] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:33.167773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.168800 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:33.186428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.187105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.187385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.187862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.188978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:33.189286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:33.190815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:33.205462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 357/731] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:33.206675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.276493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3ae5-2a04-468c-9f74-d6e734b16482 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.312269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40d7eb-7c22-444b-87ae-0d6a94d528c8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.328824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.329442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.329727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.329997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.330661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:33.332126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:33.351318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 375/732] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:16:33 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:33.352175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.367535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecf321-6d3d-49dc-90be-d83746f58ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.369182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecf321-6d3d-49dc-90be-d83746f58ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.369825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecf321-6d3d-49dc-90be-d83746f58ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.370287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecf321-6d3d-49dc-90be-d83746f58ea2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.386175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecf321-6d3d-49dc-90be-d83746f58ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:33.389034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecf321-6d3d-49dc-90be-d83746f58ea2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-43ecf321-6d3d-49dc-90be-d83746f58ea2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:33.405636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:33.406685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:33.407644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:33.415599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 358/733] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:33.418339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6f9b2-0234-4f0d-a21a-6a86abc6df2c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.419251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6f9b2-0234-4f0d-a21a-6a86abc6df2c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.419704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6f9b2-0234-4f0d-a21a-6a86abc6df2c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.422631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 359/734] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:33.423770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6f9b2-0234-4f0d-a21a-6a86abc6df2c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.435534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:33.492299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:33.499945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48fbc9-2c3a-4c51-9b77-ed493e4e2828 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.540929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1500497-dc9c-43f3-93fa-82e11fe2e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.542941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500497-dc9c-43f3-93fa-82e11fe2e927 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.542941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500497-dc9c-43f3-93fa-82e11fe2e927 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.542941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500497-dc9c-43f3-93fa-82e11fe2e927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.556708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500497-dc9c-43f3-93fa-82e11fe2e927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:33.558397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1500497-dc9c-43f3-93fa-82e11fe2e927 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:33.560112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6f9b2-0234-4f0d-a21a-6a86abc6df2c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b1500497-dc9c-43f3-93fa-82e11fe2e927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:33.576606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:33.577748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:33.580216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:33.580216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:33.580216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:33.580216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 376/735] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:33.580216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db75d5-f9b8-43d9-822b-d2b37c538862 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.580216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db75d5-f9b8-43d9-822b-d2b37c538862 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.580636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db75d5-f9b8-43d9-822b-d2b37c538862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.601055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a4db75d5-f9b8-43d9-822b-d2b37c538862 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:33.602248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a4db75d5-f9b8-43d9-822b-d2b37c538862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:33.607137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.607904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.608274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.609039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.609863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:33.610265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:33.611846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:33.634193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 360/736] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 05:16:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:33.635218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.682991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 377/737] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:33.683874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db75d5-f9b8-43d9-822b-d2b37c538862 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.753559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:33.783636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:33.793361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99424dd9-7a51-4163-9676-b3161b5f2459 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.866076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.866701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.866980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.867251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:33.867934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:33.868241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:33.869631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:33.877627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db75d5-f9b8-43d9-822b-d2b37c538862 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:33.895902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 361/738] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:33.901585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:33.931097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:33.931594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:33.931880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:33.932153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.015292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.016802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.048537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b24cdb-28d5-430e-8190-aa5734290799 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.057892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.084094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43992b-b19f-49e2-ae7c-d30ff793ba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.084829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43992b-b19f-49e2-ae7c-d30ff793ba3c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.085167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43992b-b19f-49e2-ae7c-d30ff793ba3c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.085507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43992b-b19f-49e2-ae7c-d30ff793ba3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.094626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43992b-b19f-49e2-ae7c-d30ff793ba3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.096436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43992b-b19f-49e2-ae7c-d30ff793ba3c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-8b43992b-b19f-49e2-ae7c-d30ff793ba3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:34.108309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:34.109311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:34.110260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 362/739] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:16:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:34.110877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65417be8-1a9b-41ab-a99f-1cea660208c2 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.111277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65417be8-1a9b-41ab-a99f-1cea660208c2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.111404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65417be8-1a9b-41ab-a99f-1cea660208c2 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.114897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 363/740] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:34.114897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65417be8-1a9b-41ab-a99f-1cea660208c2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.131509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 378/741] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:16:34.133022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.136601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.224335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65417be8-1a9b-41ab-a99f-1cea660208c2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.244710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf3175-7686-4302-8078-02e290a0d242 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.263653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72960a9b-9248-42f9-99d0-9e7cf69e31cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.264294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72960a9b-9248-42f9-99d0-9e7cf69e31cc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.264576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72960a9b-9248-42f9-99d0-9e7cf69e31cc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.264850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72960a9b-9248-42f9-99d0-9e7cf69e31cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.275853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72960a9b-9248-42f9-99d0-9e7cf69e31cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:34.282651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.282651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.282651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-72960a9b-9248-42f9-99d0-9e7cf69e31cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:34.282969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:34.284208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:34.285042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:34.285677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.285677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:34.285677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.285871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 364/742] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:34.285871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a216aa-ae0e-4a6f-875a-8914b9b708b3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.285871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a216aa-ae0e-4a6f-875a-8914b9b708b3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.285871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a216aa-ae0e-4a6f-875a-8914b9b708b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.288745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.301326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.302736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-46a216aa-ae0e-4a6f-875a-8914b9b708b3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:34.303988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-46a216aa-ae0e-4a6f-875a-8914b9b708b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:34.315778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 379/743] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:34.315778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.376142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 365/744] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:16:34.379832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a216aa-ae0e-4a6f-875a-8914b9b708b3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.394008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.440739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baab00-a150-44ee-aca3-51c8693348d4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.487286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.487953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.488236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.488511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.501098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.502963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.506469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a216aa-ae0e-4a6f-875a-8914b9b708b3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:34.521447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:34.522425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:34.523301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:34.523301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:34.523301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:34.527292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 380/745] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:34.529083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.548052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.548670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.548951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.549223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.549992 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:34.550300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.552049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.565504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 366/746] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:34.565504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.594083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.638078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.655811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880531b-bbc0-4228-8e2c-9b995bf9f740 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.676351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d745c3-702b-4c9e-8165-eafd5010b057 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.693451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.694092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.694371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.694642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.706132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.707626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.713556 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.714629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.714969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.715302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.716546 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:34.717039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.718464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:34.722006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:34.723118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:34.724262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:34.724262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:34.724262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:34.729959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 381/747] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:34.729959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.735297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 367/748] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:34.740479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.831624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.835074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d885f99-0916-43e2-aabc-aca8675290bd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.844342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb54b-f4bc-43bf-a22d-ed027c3e1c2b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:34.871114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.871692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:34.872146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.872423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.872830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.884613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.885545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:34.886139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.886241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:34.886432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:34.886714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:34.887560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:34.889393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:34.901370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:34.902355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:34.908885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:34.908885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:34.908885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:34.908885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 382/749] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:34.908885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:34.909219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 368/750] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:16:34 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:34.909219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.046371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28a96-c4ca-46ca-9fb5-09dd2079a94d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.063695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b182422-c46a-464e-b88e-ba103fc75e5f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.088089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.088631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.088902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.089178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.089990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:35.090292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.092712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.107867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 383/751] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:35.109021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.114118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.115024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.115304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.115592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.124846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.126323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.130380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:35.141685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:35.142668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:35.143591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 369/752] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:35.144091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.205566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:35.230161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b0dee-835f-4eb2-a7d8-9c1ed3056024 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.269044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.269810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.270072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.270482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.271150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:35.271514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.273448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.279754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f314ad8-c760-454e-ad25-b5efc38b69b2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.291017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 384/753] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:35.291017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.325673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.326620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.327171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.327452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.337081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.338615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:35.353251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:35.354198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:35.355099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 370/754] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:35.355999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.374174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:35.412712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da519e1-cc4b-4e1c-a7c9-47d52eb37064 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.452022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.453171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.453654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.454253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.455243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:35.455807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.457595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.472124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 385/755] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:35.473376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.474350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbb0a4-b3eb-4921-83bc-d1d705e42b6f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.476953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:35.510724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.511138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.511365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.511664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.524393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.526084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:35.539926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:35.540980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:35.541921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:35.546128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 371/756] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:35.547138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.593793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec72412-f0be-4d4e-b52a-e5c4f5be14aa None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.626903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:35.634064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.634686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.634967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.635237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.636022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:35.636329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.637911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.649989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 386/757] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:35.651596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.668010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49436-c429-4450-80a6-84ca923a7343 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.705038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b9686-7038-43c7-ba21-99abab043bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.705657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b9686-7038-43c7-ba21-99abab043bee None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.705938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b9686-7038-43c7-ba21-99abab043bee None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.706214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b9686-7038-43c7-ba21-99abab043bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.706942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b9686-7038-43c7-ba21-99abab043bee None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=4f85a6800f914551b065fedc9bd4b558) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:35.707257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b9686-7038-43c7-ba21-99abab043bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.708739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b9686-7038-43c7-ba21-99abab043bee None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.715604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 372/758] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/role_assignments?user.id=4f85a6800f914551b065fedc9bd4b558&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:35.715775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bd697-cbb8-424d-9378-ac9d55a1e1dc None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.716087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bd697-cbb8-424d-9378-ac9d55a1e1dc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.716187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bd697-cbb8-424d-9378-ac9d55a1e1dc None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.717658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 373/759] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:35.718386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bd697-cbb8-424d-9378-ac9d55a1e1dc None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.766930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:35.775048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c60d1-20ee-4ad6-87f0-c710bad09c8b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.819444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e666b1-5f40-4e66-be59-7bf6cd2e99e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.820132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e666b1-5f40-4e66-be59-7bf6cd2e99e5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.820416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e666b1-5f40-4e66-be59-7bf6cd2e99e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.820689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e666b1-5f40-4e66-be59-7bf6cd2e99e5 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.821618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e666b1-5f40-4e66-be59-7bf6cd2e99e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:35.821929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e666b1-5f40-4e66-be59-7bf6cd2e99e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.823608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e666b1-5f40-4e66-be59-7bf6cd2e99e5 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.846405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 387/760] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:35.848247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c9a4-85b2-4b03-8230-17fb7c0cc8b6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.848743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c9a4-85b2-4b03-8230-17fb7c0cc8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.849196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c9a4-85b2-4b03-8230-17fb7c0cc8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.873821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3950c9a4-85b2-4b03-8230-17fb7c0cc8b6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:35.876178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3950c9a4-85b2-4b03-8230-17fb7c0cc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:35.879439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bd697-cbb8-424d-9378-ac9d55a1e1dc None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:35.927101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:35.927819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:35.928101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:35.928383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/291c79a765764420a4b836c478c385b6/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:35.930492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=291c79a765764420a4b836c478c385b6, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:35.932266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:35.940410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:35.959832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 374/761] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:35 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/291c79a765764420a4b836c478c385b6/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:35.960900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:35.989618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 388/762] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:36.098592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:36.113107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3387ab-007d-41b7-8723-8a9fa86e3fff None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:36.166715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:36.167346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:36.167644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:36.167911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:36.242209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:36.243744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:36.264061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950c9a4-85b2-4b03-8230-17fb7c0cc8b6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:36.349893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:36.369508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950c9a4-85b2-4b03-8230-17fb7c0cc8b6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:36.380777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 375/763] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:16:36.386634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:36.406742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:36.407387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:36.407686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:36.407950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:36.408532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:36.409904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:36.420012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:36.421107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:36.421953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 389/764] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Sep 26 05:16:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:36.430137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:36.515850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98554449-7c17-4781-8f27-d6fba2ff6275 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:36.525422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:36.557856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bf687-8757-425d-b456-61da66eee66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:36.558879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bf687-8757-425d-b456-61da66eee66b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:36.559415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bf687-8757-425d-b456-61da66eee66b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:36.559913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bf687-8757-425d-b456-61da66eee66b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:36.572731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bf687-8757-425d-b456-61da66eee66b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:36.574479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953bf687-8757-425d-b456-61da66eee66b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-953bf687-8757-425d-b456-61da66eee66b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:36.591469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:36.592540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:36.593421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:36.593421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:36.593421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:36.595653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 376/765] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:36.601763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bf687-8757-425d-b456-61da66eee66b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:36.649683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:36.790386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bf687-8757-425d-b456-61da66eee66b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:36.831966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:36.832608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:36.832883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:36.833157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:36.833827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:36.834132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:36.835572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:36.839644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bf5cc-f008-4679-89da-c000766cc480 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:36.862023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 377/766] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:36.871039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:36.921673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:36.922292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:36.922575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:36.922841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:36.923477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:36.923801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:36.925595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:36.931051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 390/767] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 05:16:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:36.937118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:37.068083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:37.072874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34364b69-24cf-4105-9866-507981a7c0ba None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:37.133600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b2359-b951-4166-89a5-383a5a3024fe None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:37.138938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abff99-478a-438a-baa0-781e33105740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:37.139605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abff99-478a-438a-baa0-781e33105740 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.139896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abff99-478a-438a-baa0-781e33105740 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.140171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abff99-478a-438a-baa0-781e33105740 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.152517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:37.157329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abff99-478a-438a-baa0-781e33105740 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:37.159042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abff99-478a-438a-baa0-781e33105740 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-27abff99-478a-438a-baa0-781e33105740 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:37.180510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:37.181468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:37.182368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:37.186577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 378/768] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:37.188249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abff99-478a-438a-baa0-781e33105740 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:37.233020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:37.233650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.234081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.234270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.235283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:37.235652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:37.237501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:37.255143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 391/769] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 05:16:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:37.261333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:37.302385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abff99-478a-438a-baa0-781e33105740 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:37.338910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:37.339601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.339887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.340161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.341252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:37.341551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:37.343004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:37.361745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 379/770] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:37.363013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:37.386290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:37.467284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e46c3b-224b-4a6a-be65-074c84c701f3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:37.469466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3817fb6-14bf-4395-b179-51a862dfc310 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:37.506425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca87eda-10eb-4c58-a8e2-2bc53a14dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:37.507575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca87eda-10eb-4c58-a8e2-2bc53a14dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.508371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca87eda-10eb-4c58-a8e2-2bc53a14dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.509066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca87eda-10eb-4c58-a8e2-2bc53a14dbc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.510250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca87eda-10eb-4c58-a8e2-2bc53a14dbc2 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=8bd38706158a47d8b0ff2b48b0fe082a) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:37.510805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca87eda-10eb-4c58-a8e2-2bc53a14dbc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:37.512829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:37.513131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca87eda-10eb-4c58-a8e2-2bc53a14dbc2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:37.513556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.513901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.514243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.515060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] RBAC: Adding query filter params (interface=public, service_id=22f59ea329434ba499af0858e39d46a7, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:37.515434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:37.516893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:37.520761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 380/771] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:37 2022] GET /identity/v3/role_assignments?user.id=8bd38706158a47d8b0ff2b48b0fe082a&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:37.522180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683fee4-6205-4e43-a5e6-90da539c58b3 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.522616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683fee4-6205-4e43-a5e6-90da539c58b3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.523093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683fee4-6205-4e43-a5e6-90da539c58b3 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.528955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 381/772] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:37.531521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2112ef1-3624-4929-a046-832da0c32aae None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.532043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2112ef1-3624-4929-a046-832da0c32aae None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.532511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2112ef1-3624-4929-a046-832da0c32aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.536951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 392/773] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:16:37 2022] GET /identity/v3/endpoints?service_id=22f59ea329434ba499af0858e39d46a7&interface=public®ion_id=RegionOne => generated 194 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:37.542921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:37.554695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d2112ef1-3624-4929-a046-832da0c32aae None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:37.556220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d2112ef1-3624-4929-a046-832da0c32aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:37.640475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 382/774] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:37.677885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:37.765236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17cd03-3a73-42a0-bc67-d774afc3f879 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:37.817544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:37.818159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:37.818431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:37.818695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:37.819299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:37.820693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:37.832381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 393/775] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:16:37 2022] GET /identity/v3/services => generated 772 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:37.948225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2112ef1-3624-4929-a046-832da0c32aae None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:37.965482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:38.084115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2112ef1-3624-4929-a046-832da0c32aae None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:38.129540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:38.130181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.130458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.130729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] PATH_INFO: `/v3/services/network` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.131371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:38.132863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:38.141814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:38.142777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:38.143645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 383/776] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:37 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:38.152705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:38.253568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:38.257335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5cc59-a164-41bc-a7c8-56a5d6fb33a4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:38.295045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed021f-603d-4bd8-86c5-c88fc5bd580e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:38.295710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed021f-603d-4bd8-86c5-c88fc5bd580e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.295996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed021f-603d-4bd8-86c5-c88fc5bd580e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.296269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed021f-603d-4bd8-86c5-c88fc5bd580e None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.296910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed021f-603d-4bd8-86c5-c88fc5bd580e None admin] RBAC: Adding query filter params (name=network) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:38.297216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed021f-603d-4bd8-86c5-c88fc5bd580e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:38.298663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed021f-603d-4bd8-86c5-c88fc5bd580e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:38.307720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 394/777] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:38.310235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:38.435677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:38.463719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf36b5-c190-45fb-b12a-6db64fdf6c40 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:38.464712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b2f4-6d80-4e99-9613-2662ed8ac2f6 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.464993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b2f4-6d80-4e99-9613-2662ed8ac2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.465271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131b2f4-6d80-4e99-9613-2662ed8ac2f6 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.466914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 395/778] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:38.471849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24398e-cc12-46c2-9249-a3c7be34aef2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.472133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24398e-cc12-46c2-9249-a3c7be34aef2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.472409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24398e-cc12-46c2-9249-a3c7be34aef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.504242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:38.505215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.505704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.506163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.506995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:38.507486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:38.509081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:38.513300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ee24398e-cc12-46c2-9249-a3c7be34aef2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:38.514507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ee24398e-cc12-46c2-9249-a3c7be34aef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:38.516922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 384/779] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:38.523678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:38.641587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 396/780] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 26 05:16:38.692403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced255e-4aed-4e95-82da-305fde928ba3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:38.735837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9c5c1-52fa-4e2d-bc8d-76f93ebfe2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:38.736849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c5c1-52fa-4e2d-bc8d-76f93ebfe2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.737319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c5c1-52fa-4e2d-bc8d-76f93ebfe2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.737775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9c5c1-52fa-4e2d-bc8d-76f93ebfe2e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.738659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c5c1-52fa-4e2d-bc8d-76f93ebfe2e8 None admin] RBAC: Adding query filter params (interface=public, service_id=4eeffb92f7be416b9c1babb5b91db9c2, region_id=RegionOne) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:38.739169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c5c1-52fa-4e2d-bc8d-76f93ebfe2e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:38.740871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9c5c1-52fa-4e2d-bc8d-76f93ebfe2e8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:38.749162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 385/781] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:16:38 2022] GET /identity/v3/endpoints?service_id=4eeffb92f7be416b9c1babb5b91db9c2&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:38.760409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24398e-cc12-46c2-9249-a3c7be34aef2 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:38.896598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:38.907766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24398e-cc12-46c2-9249-a3c7be34aef2 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:38.949494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaeb6f-d053-4542-94d9-54103d1e687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:38.950713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaeb6f-d053-4542-94d9-54103d1e687e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.950997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaeb6f-d053-4542-94d9-54103d1e687e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.951277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaeb6f-d053-4542-94d9-54103d1e687e None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.951919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaeb6f-d053-4542-94d9-54103d1e687e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:38.953288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaeb6f-d053-4542-94d9-54103d1e687e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:38.958993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 397/782] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:16:38 2022] GET /identity/v3/services => generated 772 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:38.979100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b45c7-6336-4a76-a7b1-5cccd09380ab None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.979754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b45c7-6336-4a76-a7b1-5cccd09380ab None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.980230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b45c7-6336-4a76-a7b1-5cccd09380ab None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:38.982232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 386/783] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:38.987991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5dd9-c2d8-4024-a25b-d2232e5e4300 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:38.988275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5dd9-c2d8-4024-a25b-d2232e5e4300 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:38.988720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c5dd9-c2d8-4024-a25b-d2232e5e4300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:39.014305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-408c5dd9-c2d8-4024-a25b-d2232e5e4300 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:39.015430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-408c5dd9-c2d8-4024-a25b-d2232e5e4300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:39.040039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b45c7-6336-4a76-a7b1-5cccd09380ab None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:39.052320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:39.093175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 398/784] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:39.160845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b45c7-6336-4a76-a7b1-5cccd09380ab None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:39.201021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:39.201966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:39.202401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:39.202806 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:39.215451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:39.220561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:39.221686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:39.222723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:39.225068 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 387/785] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:39.231445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c5dd9-c2d8-4024-a25b-d2232e5e4300 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:39.327986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:39.343615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c5dd9-c2d8-4024-a25b-d2232e5e4300 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:39.379679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:39.380378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:39.380655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:39.380922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:39.381581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:39.381878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:39.383294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:39.392481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 399/786] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:39.398583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:39.453640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:39.499372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:39.559291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ab1d-e42a-4177-96b6-1484a2643e98 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:39.619820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a63e3-30e4-4be5-ae3f-f18d49b23260 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:39.624083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:39.624733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:39.625009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:39.625278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:39.647387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:39.648902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:39.674577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:39.675627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:39.676532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:39.676532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:39.676532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:39.678107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 388/787] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:39.682862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:39.683504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:39.683922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:39.684310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:39.685620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:39.706212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:39.711406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:39.712361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:39.713200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 400/788] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:39.719367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:39.743311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:39.867992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f6a0-6905-48c7-8a4a-b10d9937d13a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:39.889780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae1f96-42a0-468a-ae14-137e98078cbf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:39.906705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:39.907783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:39.908065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:39.908402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:39.909769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:39.909769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:39.910941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:39.921459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 401/789] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:39.926637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:39.932523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:39.975678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:39.976315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:39.976592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:39.976866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:39.977533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:39.977847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:39.981791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.008336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 389/790] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:40.013948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.069517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:40.108987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff361e55-b8b2-4635-96dc-d6cec21e3034 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.148614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65429de-31b8-43bd-964e-00a2ffd0838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.150193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65429de-31b8-43bd-964e-00a2ffd0838d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.150903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65429de-31b8-43bd-964e-00a2ffd0838d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.151497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65429de-31b8-43bd-964e-00a2ffd0838d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.155057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7c6ab-3aed-4c99-bd2b-129d326c1137 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.163682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65429de-31b8-43bd-964e-00a2ffd0838d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:40.165568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65429de-31b8-43bd-964e-00a2ffd0838d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b65429de-31b8-43bd-964e-00a2ffd0838d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:40.182057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:40.183053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:40.183979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:40.183979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:40.183979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:40.186553 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 402/791] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:40.188732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab48d9-436e-4267-a644-6a8067370cd7 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.189155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab48d9-436e-4267-a644-6a8067370cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.189645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab48d9-436e-4267-a644-6a8067370cd7 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.191280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 403/792] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:40.192158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab48d9-436e-4267-a644-6a8067370cd7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.206647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13f1a3-1678-44d2-9fee-7d9584557f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.207797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f1a3-1678-44d2-9fee-7d9584557f15 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.208594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f1a3-1678-44d2-9fee-7d9584557f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.208963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f1a3-1678-44d2-9fee-7d9584557f15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.220044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13f1a3-1678-44d2-9fee-7d9584557f15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:40.222482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13f1a3-1678-44d2-9fee-7d9584557f15 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ae13f1a3-1678-44d2-9fee-7d9584557f15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:40.240073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:40.241042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:40.241958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:40.247585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 390/793] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:40.249012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fc3b7-a5a5-449f-b40a-ffadf2f8a6fd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.249907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fc3b7-a5a5-449f-b40a-ffadf2f8a6fd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.250261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fc3b7-a5a5-449f-b40a-ffadf2f8a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.278157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-448fc3b7-a5a5-449f-b40a-ffadf2f8a6fd None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:40.281066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-448fc3b7-a5a5-449f-b40a-ffadf2f8a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:40.326236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:40.341992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab48d9-436e-4267-a644-6a8067370cd7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.375903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:40.376863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 391/794] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:40.377654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fc3b7-a5a5-449f-b40a-ffadf2f8a6fd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.388132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.389159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.391038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.391489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.393787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:40.394279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:40.396931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.426087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 404/795] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:40.431758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.567563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fc3b7-a5a5-449f-b40a-ffadf2f8a6fd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.580459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495ec39-88a8-4188-80ad-2c4deef50798 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.612246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780cbf8c-9210-44c1-b033-c92b54e99fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.613096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cbf8c-9210-44c1-b033-c92b54e99fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.613226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cbf8c-9210-44c1-b033-c92b54e99fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.613406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780cbf8c-9210-44c1-b033-c92b54e99fd4 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.614213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cbf8c-9210-44c1-b033-c92b54e99fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:40.614435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cbf8c-9210-44c1-b033-c92b54e99fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:40.615902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780cbf8c-9210-44c1-b033-c92b54e99fd4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.624857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160e6c8-79f7-4173-a2af-39f09dd87fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.626661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e6c8-79f7-4173-a2af-39f09dd87fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.627084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e6c8-79f7-4173-a2af-39f09dd87fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.627495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160e6c8-79f7-4173-a2af-39f09dd87fb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.634426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 392/796] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:40.635718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef486cba-51fc-4b12-9e9b-d4bfa0024764 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.636004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef486cba-51fc-4b12-9e9b-d4bfa0024764 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.636280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef486cba-51fc-4b12-9e9b-d4bfa0024764 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.636772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160e6c8-79f7-4173-a2af-39f09dd87fb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:40.637804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 393/797] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:40.638923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160e6c8-79f7-4173-a2af-39f09dd87fb8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.640465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef486cba-51fc-4b12-9e9b-d4bfa0024764 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0160e6c8-79f7-4173-a2af-39f09dd87fb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:40.652421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:40.653764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:16:40.654705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:40.657559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 405/798] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:40.659387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86dd7c-1a43-4191-885b-ad2786f0937e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.659822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86dd7c-1a43-4191-885b-ad2786f0937e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.660245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86dd7c-1a43-4191-885b-ad2786f0937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.675784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:40.681537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6b86dd7c-1a43-4191-885b-ad2786f0937e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:40.682930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6b86dd7c-1a43-4191-885b-ad2786f0937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:40.727359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:40.757516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef486cba-51fc-4b12-9e9b-d4bfa0024764 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.765064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 406/799] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:40.765064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86dd7c-1a43-4191-885b-ad2786f0937e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.793146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.794019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.794295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.794563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.805215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:40.806708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:40.821972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:40.822943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:40.824505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:40.824505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:40.824505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:40.824505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 394/800] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:40.824505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.886177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86dd7c-1a43-4191-885b-ad2786f0937e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.904868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:40.927953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829edbb-b13e-49da-b39c-0666b611f14f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:40.928448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.929057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.929330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.929597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.930322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:40.930621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:40.933161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:40.953988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 407/801] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:40.955112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.966501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:40.967497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:40.967997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:40.968459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:40.979303 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:40.984879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:40.985788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:40.986628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:40.989223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 395/802] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:40.990190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:40.994594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.072751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f888c3e-47c9-4027-899e-598e3ab1d020 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.101601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ea39d-b5bf-4b9a-b20c-1fcaa6c8c193 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.110274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.110888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.111167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.111439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.112125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:41.112430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.113818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.126015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 408/803] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:41.126854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.142682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.143301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.143614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.143878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.229477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.240300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abd1ca-d18b-496f-bb74-7365d6909384 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.272674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.279309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.280170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.280605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.280872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.281536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:41.281837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.283192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.297188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 409/804] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:41.297188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.354953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.356698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.411949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc3ec9-85d4-4d76-98c6-6fa455f49937 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.447157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.447860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.448137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.448471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.449082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.450601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:41.460709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:41.461995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:41.463115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 410/805] 10.222.0.18 () {56 vars in 1129 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:41.464028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.478449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 396/806] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:16:41.478449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.490253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.517621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.580789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9dccc-7c00-4456-bb76-17ab2da90669 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.581482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cda179-f561-4597-8c22-5b905fa429d7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.613862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.614482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.614594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.614757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.615023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.615136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.615415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.615731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.622703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.624181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.625014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.626433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:41.635917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:41.637013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 411/807] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:41.638426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:41.644356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:41.645321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:41.646317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:41.646317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:41.646317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:41.646317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 397/808] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:41.646317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.725431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.737150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.747257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125ad95-b4b0-4ad2-8cdc-0c38952b9c8e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.747838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3573140-4798-430e-89a4-520c5ab3faaf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.781211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.781449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09762a2d-5220-4e70-9628-832b68faff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.781843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.781944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762a2d-5220-4e70-9628-832b68faff56 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.782113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.782208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762a2d-5220-4e70-9628-832b68faff56 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.782376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.782478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09762a2d-5220-4e70-9628-832b68faff56 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.783017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09762a2d-5220-4e70-9628-832b68faff56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:41.783315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09762a2d-5220-4e70-9628-832b68faff56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.784702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09762a2d-5220-4e70-9628-832b68faff56 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.788961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 412/809] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:41.790099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d609a3-3031-4018-a7d1-be9bbaa0f031 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.790375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d609a3-3031-4018-a7d1-be9bbaa0f031 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.790644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d609a3-3031-4018-a7d1-be9bbaa0f031 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.791957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 413/810] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:41.792509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d609a3-3031-4018-a7d1-be9bbaa0f031 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.794215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.795475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:41.810339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:41.811330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:41.812324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:41.812324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:41.812324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:41.812324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 398/811] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:41.812324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.902294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d609a3-3031-4018-a7d1-be9bbaa0f031 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.913518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2c0a3-d451-4593-9db1-6a4ead2e39a3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:41.935571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.936180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.936451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.936717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.937401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:41.937701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.939505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.951173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c867f3-2906-47c2-ae6c-12542e446d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:41.951865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 414/812] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:41.951996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c867f3-2906-47c2-ae6c-12542e446d1b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.952185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c867f3-2906-47c2-ae6c-12542e446d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.952460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c867f3-2906-47c2-ae6c-12542e446d1b None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.952669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:41.953228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c867f3-2906-47c2-ae6c-12542e446d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:41.953542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c867f3-2906-47c2-ae6c-12542e446d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:41.955049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c867f3-2906-47c2-ae6c-12542e446d1b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:41.955445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.967703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 399/813] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:41.968904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40bd5-12d8-4151-a1ec-b2e2ccc18106 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:41.969181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40bd5-12d8-4151-a1ec-b2e2ccc18106 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:41.969464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a40bd5-12d8-4151-a1ec-b2e2ccc18106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:41.975488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:41.987791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-38a40bd5-12d8-4151-a1ec-b2e2ccc18106 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:41.988993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-38a40bd5-12d8-4151-a1ec-b2e2ccc18106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:42.054122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 400/814] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:42.055169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40bd5-12d8-4151-a1ec-b2e2ccc18106 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.056486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a986f4-0e6c-4e58-a221-8a11e85690ea None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.090380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.091152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.091436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.091744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.092400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:42.092708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.094057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.104064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 415/815] 10.222.0.18 () {56 vars in 1124 bytes} [Mon Sep 26 05:16:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:42.104064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.166219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a40bd5-12d8-4151-a1ec-b2e2ccc18106 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.172712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:42.196664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:42.202559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.203298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.203610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.203887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.204534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:42.204836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.206232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.210876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0f5de-cb89-4748-8d94-fcc27e5e2900 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.222357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 401/816] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:42.222357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.253345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.254008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.254282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.254787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/4f85a6800f914551b065fedc9bd4b558/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.257554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=4f85a6800f914551b065fedc9bd4b558, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.258979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.276082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 416/817] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:42 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/4f85a6800f914551b065fedc9bd4b558/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:42.276814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.358231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5bf4d-a0f1-4a08-8fd9-0196444e8af4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.389376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9fc29a-4a0d-4fa5-8930-0a8c578461d9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.399886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.400586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.400818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.401088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.410364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.411870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.421240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:42.426267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 402/818] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:42.427219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.437034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.438564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.438564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.438781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.439288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.440743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.469289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 417/819] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:16:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:42.470561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.496231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:42.568433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffb51c-8a69-4f4f-adcd-279d80dcff72 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.628008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.629482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.630029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.630499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.638797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd109f2f-b80c-484d-aa91-461cf80fc250 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.640419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.643532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:42.658773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:42.660177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:42.661292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:42.667632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 403/820] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:42.667632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.697607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.698098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.698391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.698702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.699245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.700716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:42.711583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:42.712614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:42.713452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 418/821] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:42.714273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.764547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:42.785906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f042c-e0c8-4eb9-a441-b244d998c966 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.796080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:42.827160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.828184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.828664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.829198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.830165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:42.830668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.832406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.836967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e3c17-f51b-42a1-a2b8-bb5e76d946c2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:42.851431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 404/822] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:42.852672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.881572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:42.882679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:42.883155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:42.883756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:42.884651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:42.885370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:42.887998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:42.907898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 419/823] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:42.909951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:42.972850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0342f-d7ff-4874-b4e1-4952b5108ad5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.008852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.009878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.010357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.010851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.011785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] RBAC: Adding query filter params (name=network) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:43.012361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.013938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.019397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 405/824] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:43.020559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:43.032447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06237ca0-c736-453e-8eef-8d3d8ee083a9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.034168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:43.056020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:43.072893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.073553 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.073836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.074113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.086140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.087627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:43.104642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:43.105651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:43.106602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:43.106602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:43.106602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:43.111094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 420/825] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:43.112000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:43.137881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3205ba-2500-44e4-aaea-d43e57e3ad5f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.174511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.175478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.176060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.176623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.177617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=291c79a765764420a4b836c478c385b6) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:43.178211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.180100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.190965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 406/826] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:43 2022] GET /identity/v3/role_assignments?user.id=291c79a765764420a4b836c478c385b6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:43.190965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:43.298853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4540dc9-bfb1-4b46-bcfc-4e56d5d10f7e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.327960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:43.334960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc508b57-a969-4ce3-9d01-594b2087c4ab None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.372874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.373616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.373898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.374172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.374866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] RBAC: Adding query filter params (type=network) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:43.375176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.376602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.387607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 421/827] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:43.393519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:43.408322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.408956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.409232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.409503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.411330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:43.411686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.414372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.434062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:43.443671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 407/828] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:43.452418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:43.557450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91884820-9059-4e0b-a296-4078e61e7b89 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.592696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c2cc-5dc4-469f-96ff-1725b8649c0f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.602105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.603109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.603391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.603690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.604376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.607116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.639572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 422/829] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:16:43 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:16:43.652394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.653082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.653966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.654246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.662696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.664357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:43.679893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:43.680867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:43.681772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 408/830] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:43.688728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:43.776294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:43.805681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72520af-8c1a-4580-a76d-ee5468bee9fb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:43.844901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec491986-753b-4a9f-b03d-b1c8f13a7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:43.845526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491986-753b-4a9f-b03d-b1c8f13a7ffa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:43.845804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491986-753b-4a9f-b03d-b1c8f13a7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:43.846074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec491986-753b-4a9f-b03d-b1c8f13a7ffa None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:43.846772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491986-753b-4a9f-b03d-b1c8f13a7ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:43.847080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491986-753b-4a9f-b03d-b1c8f13a7ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:43.848545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec491986-753b-4a9f-b03d-b1c8f13a7ffa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:43.863254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 423/831] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:43.869159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:43.883938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:43.979839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8cbf5-5c88-4da9-8d30-b17ced6513f7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:44.016750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f6b9-bfe2-420b-97db-d8139134f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:44.017418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f6b9-bfe2-420b-97db-d8139134f4f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:44.017695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f6b9-bfe2-420b-97db-d8139134f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:44.017963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f6b9-bfe2-420b-97db-d8139134f4f8 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/8bd38706158a47d8b0ff2b48b0fe082a/roles/1ab617a329104fd79ddc9e4476562ada` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:44.034178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f6b9-bfe2-420b-97db-d8139134f4f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=8bd38706158a47d8b0ff2b48b0fe082a, role_id=1ab617a329104fd79ddc9e4476562ada)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:44.035665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f6b9-bfe2-420b-97db-d8139134f4f8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:44.056521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 409/832] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:43 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/8bd38706158a47d8b0ff2b48b0fe082a/roles/1ab617a329104fd79ddc9e4476562ada => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:44.619125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ebce2-b775-40d7-ae11-0dbc35ca8cd1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:44.619691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ebce2-b775-40d7-ae11-0dbc35ca8cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:44.619691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ebce2-b775-40d7-ae11-0dbc35ca8cd1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:44.621238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 424/833] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:44.626748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108560-9349-4f8e-8603-eeead7bc4e5a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:44.627037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108560-9349-4f8e-8603-eeead7bc4e5a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:44.627307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13108560-9349-4f8e-8603-eeead7bc4e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:44.646918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-13108560-9349-4f8e-8603-eeead7bc4e5a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:44.648122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-13108560-9349-4f8e-8603-eeead7bc4e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:44.706376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:44.721991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 410/834] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:44.826103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a56a-41eb-4984-8ef6-faccf30f999c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:44.826413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a56a-41eb-4984-8ef6-faccf30f999c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:44.826810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12a56a-41eb-4984-8ef6-faccf30f999c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:44.828532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 425/835] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:44.835581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523319f-62af-4833-b926-e56c89eb6813 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:44.835963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523319f-62af-4833-b926-e56c89eb6813 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:44.836304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523319f-62af-4833-b926-e56c89eb6813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:44.854848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2523319f-62af-4833-b926-e56c89eb6813 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:44.856114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2523319f-62af-4833-b926-e56c89eb6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:44.929232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 411/836] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:44.995371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a56a-41eb-4984-8ef6-faccf30f999c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.100316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12a56a-41eb-4984-8ef6-faccf30f999c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.134434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.135066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.135347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.135651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.137733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:45.147525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:45.152633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:45.153826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:45.155893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 426/837] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:45.159782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523319f-62af-4833-b926-e56c89eb6813 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.205414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.279408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523319f-62af-4833-b926-e56c89eb6813 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.311038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:45.330479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.331131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.331692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.331973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.333055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:45.333366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:45.335025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:45.336231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e12ff-e8a3-47b1-9ccf-d5636aa09bb2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.345903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 412/838] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:45.351196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.379620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.380306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.380581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.380883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.381716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:45.382900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:45.392601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:45.393639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:45.394491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 427/839] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:45.401049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.463059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:45.495881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc143-6c1c-47d5-a38d-c4060ba45212 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.506471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64412625-e955-4569-bfe1-68c617b8a343 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.539428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.539962 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.540238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.540505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.552379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:45.553589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.553812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:45.554653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.555125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.555901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.557182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:45.557706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:45.559654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:45.571021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:45.572126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:45.573023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:45.573023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:45.573023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:45.573663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 428/841] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:45.574722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 413/841] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:45.575808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.576054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.611408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:45.704205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a78a7-1230-4e90-a5a1-6fb11add3326 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.708708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424967d4-df6e-4e80-8757-1bfbdb4acb81 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.739314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.740051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.740418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.740777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.741514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:45.741783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:45.741990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:45.743442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:45.757085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293b2d1-f565-4160-a37f-ee241ca0e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.757976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b2d1-f565-4160-a37f-ee241ca0e899 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.758429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b2d1-f565-4160-a37f-ee241ca0e899 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.758857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293b2d1-f565-4160-a37f-ee241ca0e899 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.759710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b2d1-f565-4160-a37f-ee241ca0e899 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:45.760175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b2d1-f565-4160-a37f-ee241ca0e899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:45.761763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293b2d1-f565-4160-a37f-ee241ca0e899 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:45.762530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 414/842] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:45.763871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:45.774524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 429/843] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:45.774524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21545aa-eb6d-4948-8bfa-43188eb0be14 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.774524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21545aa-eb6d-4948-8bfa-43188eb0be14 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.774524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21545aa-eb6d-4948-8bfa-43188eb0be14 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.774524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 430/844] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:45.779275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294301fb-a220-4fe4-b4f2-df98da84f522 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.779850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294301fb-a220-4fe4-b4f2-df98da84f522 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.779850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294301fb-a220-4fe4-b4f2-df98da84f522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.804070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-294301fb-a220-4fe4-b4f2-df98da84f522 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:45.805308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-294301fb-a220-4fe4-b4f2-df98da84f522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:45.887874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 431/845] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:45.898011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:45.906559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48715e-4bf8-4e49-a2ee-1d5d133965cb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:45.947167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:45.947848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:45.948125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:45.948396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:45.958241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:45.958652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:45.971372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:45.972383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:45.973326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 415/846] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:45.979283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294301fb-a220-4fe4-b4f2-df98da84f522 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.081638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294301fb-a220-4fe4-b4f2-df98da84f522 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:46.098559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:46.117935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:46.118548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.118824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.119093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.119852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:46.120157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:46.121661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:46.143670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 432/847] 10.222.0.18 () {56 vars in 1135 bytes} [Mon Sep 26 05:16:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:46.145290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.156148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.254265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82430abf-9ded-4226-9b16-b87219591637 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:46.287051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfcf63-df26-42c1-9230-c0f92c93fdda None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:46.301613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f15ad-5ca8-4c97-b8cf-f72448d57623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:46.302637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f15ad-5ca8-4c97-b8cf-f72448d57623 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.303142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f15ad-5ca8-4c97-b8cf-f72448d57623 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.303691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f15ad-5ca8-4c97-b8cf-f72448d57623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.329609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:46.330253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.330529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.330802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.330918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:46.331578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:46.332988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:46.344807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:46.345806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:46.346705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 433/848] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:46.353252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.386884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f15ad-5ca8-4c97-b8cf-f72448d57623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:46.390431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f15ad-5ca8-4c97-b8cf-f72448d57623 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:46.396385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:46.460186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39708391-d4ed-4716-b399-1cdb80569868 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:46.494465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d0ee1-df2c-4680-9a2d-7bf6f7093224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:46.495078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d0ee1-df2c-4680-9a2d-7bf6f7093224 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.495356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d0ee1-df2c-4680-9a2d-7bf6f7093224 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.495651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d0ee1-df2c-4680-9a2d-7bf6f7093224 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.496284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d0ee1-df2c-4680-9a2d-7bf6f7093224 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:46.496858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d0ee1-df2c-4680-9a2d-7bf6f7093224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:46.498231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d0ee1-df2c-4680-9a2d-7bf6f7093224 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:46.501133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 416/849] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:16:46.502754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c0df-414c-42c5-9388-a99638956855 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.503041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c0df-414c-42c5-9388-a99638956855 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.503312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868c0df-414c-42c5-9388-a99638956855 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.504687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 417/850] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:46.512291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868c0df-414c-42c5-9388-a99638956855 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.512465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 434/851] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:46.513640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad6bb-08c0-4670-a0ca-24b1ed80112f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.513928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad6bb-08c0-4670-a0ca-24b1ed80112f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.514200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ad6bb-08c0-4670-a0ca-24b1ed80112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.531976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6f6ad6bb-08c0-4670-a0ca-24b1ed80112f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:46.533209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6f6ad6bb-08c0-4670-a0ca-24b1ed80112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:46.571863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:46.603468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 435/852] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:46.612729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad6bb-08c0-4670-a0ca-24b1ed80112f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.620754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868c0df-414c-42c5-9388-a99638956855 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:46.654548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:46.657856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:46.658656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.659062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.659425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.673516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:46.675259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:46.693265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:46.694509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:46.695729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:46.695729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:46.695729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:46.701885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 418/853] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:46.702860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.752760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ad6bb-08c0-4670-a0ca-24b1ed80112f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:46.793557 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:46.794314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.794679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.795052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.795801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:46.796497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:46.797792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:46.807572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 436/854] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:46.821338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ec70e-73c9-44f4-acba-78a0a62e116a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:46.834325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:46.861859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e88575-4942-4286-940e-12b121636142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:46.862523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88575-4942-4286-940e-12b121636142 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:46.862798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88575-4942-4286-940e-12b121636142 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:46.863063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e88575-4942-4286-940e-12b121636142 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:46.863743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e88575-4942-4286-940e-12b121636142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:46.864046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e88575-4942-4286-940e-12b121636142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:46.865416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e88575-4942-4286-940e-12b121636142 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:46.873343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:46.880653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 419/855] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:46.886698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e88575-4942-4286-940e-12b121636142 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.000262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:47.010089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57263670-0c7d-41d7-80bd-b1db2eaaeff9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.026594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e88575-4942-4286-940e-12b121636142 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.059977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.060690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.060975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.061262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.065783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.066657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.067114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.067569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.072709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:47.075032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:47.076715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:47.078033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:47.078961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:16:47.079842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:47.083682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 437/856] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:47.085438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:47.092807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:47.093699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:47.094639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:47.097012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 420/857] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:47.102878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.135479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:47.210834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98fbf6-bb04-4d93-978b-7c9886096485 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.228227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988958e-7a12-4210-bb39-02d1fd15582b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.251977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.252878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.253327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.253866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.254720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:47.255287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:47.257398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:47.264276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.264972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.265365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.265714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.266542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:47.266921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:47.267805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 438/858] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:16:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:47.272658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:47.273789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.288240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 421/859] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:47.294553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.311900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:47.403743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b2cd4-8179-46e2-9f50-1142bdf7db0d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.413909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:47.436651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692cb19-efbe-4fe8-8e8d-b656e6135d61 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.444287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.445031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.445376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.445719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.458370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:47.460209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:47.476821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:47.477980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:47.478965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:47.478965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:47.478965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:47.479135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 439/860] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:47.483567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.483567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.483567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.483567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.484055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=4f85a6800f914551b065fedc9bd4b558) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:47.484055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:47.484055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:47.485128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.491837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 422/861] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:47 2022] GET /identity/v3/role_assignments?user.id=4f85a6800f914551b065fedc9bd4b558&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:47.573368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:47.609479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef8c94-a7ff-47cb-9ebe-a941fc7473a6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.647028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.647728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.648005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.648279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.648937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:47.649241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:47.650650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:47.664768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 440/862] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:47.672728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.788463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba273b-1c27-49a9-965d-03fdd6d8c31a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.824158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce662bff-bcd0-4eaf-b939-0d6c75f45bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:47.824976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662bff-bcd0-4eaf-b939-0d6c75f45bbf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.825112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662bff-bcd0-4eaf-b939-0d6c75f45bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.825455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce662bff-bcd0-4eaf-b939-0d6c75f45bbf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.833379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce662bff-bcd0-4eaf-b939-0d6c75f45bbf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:47.834833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce662bff-bcd0-4eaf-b939-0d6c75f45bbf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ce662bff-bcd0-4eaf-b939-0d6c75f45bbf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:47.847636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:47.849774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:47.851040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 423/863] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:16:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:47.855123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:47.968252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ef55a-2d27-4cf7-8075-bbecf64719de None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.968764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd515b3-9a9c-48e0-babe-8a96ee18434c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:47.969102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ef55a-2d27-4cf7-8075-bbecf64719de None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.969570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ef55a-2d27-4cf7-8075-bbecf64719de None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:47.974429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 424/864] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:47.981471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094357-1180-40ee-979d-4cd19aef21b9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:47.981471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094357-1180-40ee-979d-4cd19aef21b9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:47.981713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18094357-1180-40ee-979d-4cd19aef21b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:48.003422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-18094357-1180-40ee-979d-4cd19aef21b9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:48.004833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-18094357-1180-40ee-979d-4cd19aef21b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:48.008980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:48.009376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:48.014464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:48.015383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:48.015988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:48.016456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:48.017433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:48.017952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:48.019574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:48.039386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 441/865] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 05:16:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:48.044992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:48.097073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 425/866] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:48.159998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba246b0e-99df-4ea0-95ca-a5ae98718db1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:48.195314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:48.195964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:48.196246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:48.196518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:48.252395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:48.264594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:48.266379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:48.371356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 442/867] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:48 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:16:48.372780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18094357-1180-40ee-979d-4cd19aef21b9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:48.378174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:48.479828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:48.484965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18094357-1180-40ee-979d-4cd19aef21b9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:48.495525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd072b-cf27-46c5-8bf0-bb874455c5c4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:48.524825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:48.525474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:48.525854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:48.526128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:48.535716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:48.539149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:48.540631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:48.540764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:48.541768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:48.542046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:48.542917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:48.543810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:48.545298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:48.556603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:48.557574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:48.558478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:48.558478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:48.558478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:48.558478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 426/868] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:48.565489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:48.569195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 443/869] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:16:48 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:16:48.683383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff7c2a-5fe3-48b7-998f-b075b5d8f51d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:48.731317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:48.732382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:48.732663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:48.732932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:48.733587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:48.733894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:48.735344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:48.756703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 427/870] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:48.758135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:48.870814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb3c3b-8365-45c6-ba00-394dadd17949 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:48.908684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9aef3b-a476-43da-bc84-3f2e7d669a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:48.909336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aef3b-a476-43da-bc84-3f2e7d669a91 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:48.909615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aef3b-a476-43da-bc84-3f2e7d669a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:48.909884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aef3b-a476-43da-bc84-3f2e7d669a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:48.917091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9aef3b-a476-43da-bc84-3f2e7d669a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:48.919249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9aef3b-a476-43da-bc84-3f2e7d669a91 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-8e9aef3b-a476-43da-bc84-3f2e7d669a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:48.930681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:48.931702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:48.932691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:48.935674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 444/871] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:48.939001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:48.995929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:49.050064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f2a8b-ad7c-47f1-8377-5006782f72ec None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:49.084752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb549-d00a-41de-831d-7590de5060b9 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:49.085099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb549-d00a-41de-831d-7590de5060b9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:49.085295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb549-d00a-41de-831d-7590de5060b9 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:49.086539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:49.086927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 445/872] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:49.087149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:49.087422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:49.087722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:49.088414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:49.088715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:49.090203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:49.097778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47427bfc-d0bf-4eb6-8a9d-5851c3168fe3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:49.098055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47427bfc-d0bf-4eb6-8a9d-5851c3168fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:49.098320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47427bfc-d0bf-4eb6-8a9d-5851c3168fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:49.111871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 428/873] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:49.114932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:49.117461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-47427bfc-d0bf-4eb6-8a9d-5851c3168fe3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:49.118791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-47427bfc-d0bf-4eb6-8a9d-5851c3168fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:49.121215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:49.200111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 446/874] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:49.233845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead2773-1774-44c9-925b-81047b984c0e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:49.244666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:49.269573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ef7a1-1501-4779-83e3-940032f5bebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:49.270239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef7a1-1501-4779-83e3-940032f5bebb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:49.270517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef7a1-1501-4779-83e3-940032f5bebb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:49.270786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ef7a1-1501-4779-83e3-940032f5bebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:49.271635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ef7a1-1501-4779-83e3-940032f5bebb None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=8bd38706158a47d8b0ff2b48b0fe082a) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:49.271948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ef7a1-1501-4779-83e3-940032f5bebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:49.273384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ef7a1-1501-4779-83e3-940032f5bebb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:49.285002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 429/875] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:49 2022] GET /identity/v3/role_assignments?user.id=8bd38706158a47d8b0ff2b48b0fe082a&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:49.468420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47427bfc-d0bf-4eb6-8a9d-5851c3168fe3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:49.568748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47427bfc-d0bf-4eb6-8a9d-5851c3168fe3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:49.605773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe120033-1686-45e5-a59f-11aef3c9abbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:49.606778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120033-1686-45e5-a59f-11aef3c9abbd None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:49.607257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120033-1686-45e5-a59f-11aef3c9abbd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:49.607770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe120033-1686-45e5-a59f-11aef3c9abbd None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:49.608616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe120033-1686-45e5-a59f-11aef3c9abbd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:49.610195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe120033-1686-45e5-a59f-11aef3c9abbd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:49.622255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:49.629478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 447/876] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:16:49 2022] POST /identity/v3/services => generated 269 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:49.828443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444fc4-0447-4caa-affb-e3ab9f3b3552 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:49.828794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444fc4-0447-4caa-affb-e3ab9f3b3552 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:49.828907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78444fc4-0447-4caa-affb-e3ab9f3b3552 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:49.830377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 430/877] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:49.835626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e109f-85c6-45ff-98d6-db2a685599b9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:49.836183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e109f-85c6-45ff-98d6-db2a685599b9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:49.836682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e109f-85c6-45ff-98d6-db2a685599b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:49.855886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-423e109f-85c6-45ff-98d6-db2a685599b9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:49.857088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-423e109f-85c6-45ff-98d6-db2a685599b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:49.933457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 448/878] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:50.197236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444fc4-0447-4caa-affb-e3ab9f3b3552 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:50.308030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78444fc4-0447-4caa-affb-e3ab9f3b3552 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:50.343815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:50.344495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:50.344837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:50.345111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:50.345695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:50.347137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:50.356330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:50.357389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:50.358239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 431/879] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:50.363803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e109f-85c6-45ff-98d6-db2a685599b9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:50.465606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e109f-85c6-45ff-98d6-db2a685599b9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:50.489604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:50.501107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3125d-6e1a-4919-a4b5-1aa1837b7236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:50.501725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3125d-6e1a-4919-a4b5-1aa1837b7236 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:50.502063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3125d-6e1a-4919-a4b5-1aa1837b7236 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:50.502333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3125d-6e1a-4919-a4b5-1aa1837b7236 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:50.502968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3125d-6e1a-4919-a4b5-1aa1837b7236 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:50.503313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3125d-6e1a-4919-a4b5-1aa1837b7236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:50.504725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd3125d-6e1a-4919-a4b5-1aa1837b7236 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:50.509898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 449/880] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:16:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:50.515744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:50.554584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:50.625763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4e20d-cd2c-40c0-ad20-263e52e98180 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:50.661623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4c684-945b-4552-9890-68a5f9ae9d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:50.662236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4c684-945b-4552-9890-68a5f9ae9d4b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:50.662515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4c684-945b-4552-9890-68a5f9ae9d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:50.662828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4c684-945b-4552-9890-68a5f9ae9d4b None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:50.663466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4c684-945b-4552-9890-68a5f9ae9d4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:50.663794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4c684-945b-4552-9890-68a5f9ae9d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:50.665167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4c684-945b-4552-9890-68a5f9ae9d4b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:50.670198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 432/881] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:16:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:50.918089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eebf3-eb44-4b39-891e-360b77e467d3 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:50.918089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eebf3-eb44-4b39-891e-360b77e467d3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:50.918089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eebf3-eb44-4b39-891e-360b77e467d3 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:50.918854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 450/882] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:50.924457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fb1a4-42b2-4197-9a27-3fbb9528f4df None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:50.924978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fb1a4-42b2-4197-9a27-3fbb9528f4df None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:50.925459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fb1a4-42b2-4197-9a27-3fbb9528f4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:50.944768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5a7fb1a4-42b2-4197-9a27-3fbb9528f4df None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:50.946307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5a7fb1a4-42b2-4197-9a27-3fbb9528f4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:51.017522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 433/883] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:51.288395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545eebf3-eb44-4b39-891e-360b77e467d3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:51.402804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545eebf3-eb44-4b39-891e-360b77e467d3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:51.438228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae556c4e-2d84-4d81-9911-b4afa079ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:51.438862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556c4e-2d84-4d81-9911-b4afa079ff10 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.439138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556c4e-2d84-4d81-9911-b4afa079ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.439403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae556c4e-2d84-4d81-9911-b4afa079ff10 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.440019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae556c4e-2d84-4d81-9911-b4afa079ff10 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:51.441372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae556c4e-2d84-4d81-9911-b4afa079ff10 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-ae556c4e-2d84-4d81-9911-b4afa079ff10 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:51.450355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:51.451375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:51.452277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 451/884] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:51.459514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fb1a4-42b2-4197-9a27-3fbb9528f4df None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:51.492932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:51.577871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fb1a4-42b2-4197-9a27-3fbb9528f4df None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:51.614924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d94cc-1904-429e-abe2-e49de1144d85 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.615284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:51.615807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d94cc-1904-429e-abe2-e49de1144d85 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.615928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.616202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.616474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.616807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d94cc-1904-429e-abe2-e49de1144d85 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.617113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:51.617417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:51.618850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:51.619238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 452/885] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:51.624873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343d8f-fa64-4d21-9856-16b8774920cf None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.625305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 434/886] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:51.625635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343d8f-fa64-4d21-9856-16b8774920cf None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.625982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1343d8f-fa64-4d21-9856-16b8774920cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.630464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:51.645181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c1343d8f-fa64-4d21-9856-16b8774920cf None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:51.647992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c1343d8f-fa64-4d21-9856-16b8774920cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:51.697504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:51.727792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 453/887] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:51.734290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:51.741781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad73662-5de4-4873-a44b-a9d1ab4ed7d6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:51.779844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6c5ac-a251-4717-b131-e04c30caf66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:51.780548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c5ac-a251-4717-b131-e04c30caf66c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.780831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c5ac-a251-4717-b131-e04c30caf66c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.781105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6c5ac-a251-4717-b131-e04c30caf66c None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.781822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c5ac-a251-4717-b131-e04c30caf66c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:51.782129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c5ac-a251-4717-b131-e04c30caf66c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:51.783636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6c5ac-a251-4717-b131-e04c30caf66c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:51.790023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 435/888] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:51.795892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1343d8f-fa64-4d21-9856-16b8774920cf None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:51.906127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1343d8f-fa64-4d21-9856-16b8774920cf None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:51.908671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bb7c3-1ab9-463c-ade9-8f0ccd96b80b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.909109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bb7c3-1ab9-463c-ade9-8f0ccd96b80b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.909520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bb7c3-1ab9-463c-ade9-8f0ccd96b80b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.915031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 436/889] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:51.916754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b8787-290d-4ca0-b96c-4de3679dd6d9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.917274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b8787-290d-4ca0-b96c-4de3679dd6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.917745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b8787-290d-4ca0-b96c-4de3679dd6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.936946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fa0b8787-290d-4ca0-b96c-4de3679dd6d9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:51.939054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fa0b8787-290d-4ca0-b96c-4de3679dd6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:51.941757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:51.942349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:51.942629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:51.942897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:51.944189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] RBAC: Adding query filter params (interface=public, service_id=6c0c612c92f04177856d7e7f22150f4a, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:51.944189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:51.945281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:51.950837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 454/890] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:16:51 2022] GET /identity/v3/endpoints?service_id=6c0c612c92f04177856d7e7f22150f4a&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:51.956055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.011506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:52.027599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 437/891] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:16:52.027599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b8787-290d-4ca0-b96c-4de3679dd6d9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.074824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d541b4-25ff-453e-a6fc-850d80f119ca None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.111909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.112789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.113221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.113641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.114400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.116191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:52.122920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 455/892] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:16:51 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:16:52.136028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:52.144913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b8787-290d-4ca0-b96c-4de3679dd6d9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.184303 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.185208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.185659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.186083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.198924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:52.204163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:52.205355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:16:52.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:52.208502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 438/893] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:52.214761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.313743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.332690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa627b-96d5-406d-a10d-b63781475338 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.346109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:52.370824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.371743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.372331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.372331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.372938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:52.373255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.374778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:52.384423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 456/894] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:52.390114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.446145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2e324-39ad-4e1f-be44-28b1f324d6da None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.493626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.495500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.495966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.496571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.497698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.499859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:52.511943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4235c0-4110-4c04-b14a-7c49a255474c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:52.512378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:52.513318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:52.514211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:52.518623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 439/895] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:52.520791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.540756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:52.560225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.561397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.562013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.562485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.575854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.577761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:52.593916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:52.594954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:52.596323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:52.596323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:52.596323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:52.598240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 457/896] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:52.607599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.637605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:52.643478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd769f-6650-49dd-9d9e-1b99e0632fe5 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.686951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.687374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.687677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.688980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:52.689281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.690697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:52.700826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 440/897] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:52.702244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.723312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2295d-7290-4b57-8c77-2cf718767b30 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.768700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.769313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.769589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.769857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.770740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:52.771044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.773074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:52.793294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:52.803180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 458/898] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:52.805094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.837566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a126d4b-4c08-4a8f-9fde-8121e19d04cf None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.887094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.887879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.888180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.888453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.889115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:52.889413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.891676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:52.903679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 441/899] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:52.905945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:52.923705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:52.941442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd3d2-5691-42bd-b7dc-ad4c451e6eb6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:52.977367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b97056-991a-4bd8-8452-a718eb6ddaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:52.977929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b97056-991a-4bd8-8452-a718eb6ddaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:52.978211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b97056-991a-4bd8-8452-a718eb6ddaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:52.978484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b97056-991a-4bd8-8452-a718eb6ddaa2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:52.986900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b97056-991a-4bd8-8452-a718eb6ddaa2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:52.988780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b97056-991a-4bd8-8452-a718eb6ddaa2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-24b97056-991a-4bd8-8452-a718eb6ddaa2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:53.000312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:53.001484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:53.002562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 459/900] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:53.003169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7672ca-1596-4bec-8027-9386ee08c2dd None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.003169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7672ca-1596-4bec-8027-9386ee08c2dd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.003414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7672ca-1596-4bec-8027-9386ee08c2dd None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.004834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 460/901] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:53.009521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7672ca-1596-4bec-8027-9386ee08c2dd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:53.017913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4450d20-f71c-4daf-b4f6-b2b47d9ed7e8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:53.055924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91866fbc-cb69-4ce3-8d61-b3c8c9067e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:53.056554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866fbc-cb69-4ce3-8d61-b3c8c9067e4e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.056838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866fbc-cb69-4ce3-8d61-b3c8c9067e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.057112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866fbc-cb69-4ce3-8d61-b3c8c9067e4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.057826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866fbc-cb69-4ce3-8d61-b3c8c9067e4e None admin] RBAC: Adding query filter params (interface=public, service_id=9f0d147eba5148669355a151732e254f, region_id=RegionOne) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:53.058144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866fbc-cb69-4ce3-8d61-b3c8c9067e4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:53.059598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866fbc-cb69-4ce3-8d61-b3c8c9067e4e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.070097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 442/902] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:16:52 2022] GET /identity/v3/endpoints?service_id=9f0d147eba5148669355a151732e254f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:53.070097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a1c9-0c90-49e5-a9e9-a5e3929a1df4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.070097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a1c9-0c90-49e5-a9e9-a5e3929a1df4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.070097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a1c9-0c90-49e5-a9e9-a5e3929a1df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.074391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:53.087031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ff04a1c9-0c90-49e5-a9e9-a5e3929a1df4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:53.088336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ff04a1c9-0c90-49e5-a9e9-a5e3929a1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:53.134108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7672ca-1596-4bec-8027-9386ee08c2dd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:53.165974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 443/903] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:53.166608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a1c9-0c90-49e5-a9e9-a5e3929a1df4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:53.179769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:53.180980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.181560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.182485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.183835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:53.184429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:53.186598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.214765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 461/904] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 05:16:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:53.215894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:53.218815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:53.287654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a1c9-0c90-49e5-a9e9-a5e3929a1df4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:53.325031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5b66d-2385-47ec-94cc-adc522137930 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:53.329915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:53.330768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.331215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.331693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.332491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:53.334025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.335262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:53.348036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 444/905] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:16:53 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:16:53.364696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:53.365405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.365599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.365875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.446605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:53.456453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:53.458349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.460787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:53.576267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 462/906] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:16:53 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:16:53.582080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:53.583280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5994c-cf6e-4849-a6ac-36df2cf5ed6a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:53.625695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:53.626778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.627261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.627780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.628654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:53.630813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.655133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 445/907] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:16:53 2022] POST /identity/v3/services => generated 241 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:16:53.706196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e44e76-c3ec-4bed-a317-229d39ff81cb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:53.707811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:53.757702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:53.758358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.758638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.758912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.770946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:53.772454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:53.789725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:53.790765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:53.791731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:53.791731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:53.791731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:53.791731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 463/908] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:53.797251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:53.869221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:53.919654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eff888-30d1-4a4f-b4af-c60f1b9652d1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:53.956610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:53.957228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:53.957507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:53.957781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:53.958428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:53.958734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:53.960156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:53.973255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 446/909] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:53.978625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:54.086060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49882a4-b316-4264-a1fa-80f8d4589aa2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:54.123876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:54.124893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:54.125376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:54.125866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:54.133379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:54.135152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:54.147751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:54.148703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:54.149709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:54.152365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 464/910] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:54.158799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:54.272985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d7314-bfbb-46b8-8615-4193bbd86377 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:54.295965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:54.313221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7353f6-191e-4a09-b337-9f83fb112c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:54.313909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7353f6-191e-4a09-b337-9f83fb112c29 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:54.314195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7353f6-191e-4a09-b337-9f83fb112c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:54.314465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7353f6-191e-4a09-b337-9f83fb112c29 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:54.315177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7353f6-191e-4a09-b337-9f83fb112c29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:54.315485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7353f6-191e-4a09-b337-9f83fb112c29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:54.317002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7353f6-191e-4a09-b337-9f83fb112c29 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:54.331206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 447/911] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:54.337092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:54.345100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e042-dff0-47ac-8062-545c26edd7e5 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:54.345387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e042-dff0-47ac-8062-545c26edd7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:54.345670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7e042-dff0-47ac-8062-545c26edd7e5 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:54.347233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 448/912] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:54.351871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:54.352112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9ec3-6bae-430d-ba2b-40c1a37defa6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:54.352398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9ec3-6bae-430d-ba2b-40c1a37defa6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:54.352675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b9ec3-6bae-430d-ba2b-40c1a37defa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:54.371224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-257b9ec3-6bae-430d-ba2b-40c1a37defa6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:54.372453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-257b9ec3-6bae-430d-ba2b-40c1a37defa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:54.451272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 449/913] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:16:54.461216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dd990-64cb-4c26-a0e2-4644b8770ec6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:54.498577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:54.499198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:54.499478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:54.499788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:54.500521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] RBAC: Adding query filter params (role.id=b9183d1fb23548d3b90a5b072fc9b91e, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=8bd38706158a47d8b0ff2b48b0fe082a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:54.500833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:54.502332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:54.508562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 465/914] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:16:54 2022] GET /identity/v3/role_assignments?user.id=8bd38706158a47d8b0ff2b48b0fe082a&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=b9183d1fb23548d3b90a5b072fc9b91e => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:54.713588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9ec3-6bae-430d-ba2b-40c1a37defa6 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:54.815475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b9ec3-6bae-430d-ba2b-40c1a37defa6 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:54.825115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:54.851484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:54.852154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:54.852432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:54.852706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:54.853297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:54.854666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:54.863710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:54.865917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:54.867914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 450/915] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:54.871576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:54.954941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:54.982212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5482e8-6955-4f46-8dca-d567a07336f9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:55.017649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:55.018269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:55.018554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:55.018832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:55.019468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:55.019804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:55.021179 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:55.026512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 466/916] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:55.032218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:55.139573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c517966-5a78-4765-88cd-1c6187e8473d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:55.175656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6dce38-a9d8-4c29-89a7-f45e6d18e040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:55.176276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dce38-a9d8-4c29-89a7-f45e6d18e040 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:55.176554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dce38-a9d8-4c29-89a7-f45e6d18e040 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:55.176826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6dce38-a9d8-4c29-89a7-f45e6d18e040 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:55.177474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dce38-a9d8-4c29-89a7-f45e6d18e040 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:55.177776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dce38-a9d8-4c29-89a7-f45e6d18e040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:55.179157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6dce38-a9d8-4c29-89a7-f45e6d18e040 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:55.184785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 451/917] 10.222.0.18 () {56 vars in 1114 bytes} [Mon Sep 26 05:16:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:55.192651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:55.298671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0afec5-ef47-4991-86b0-387ca0d7cbef None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:55.333973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c022e-7de6-46d0-a4d3-95d42056456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:55.334591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c022e-7de6-46d0-a4d3-95d42056456f None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:55.334870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c022e-7de6-46d0-a4d3-95d42056456f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:55.335140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c022e-7de6-46d0-a4d3-95d42056456f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:55.335839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c022e-7de6-46d0-a4d3-95d42056456f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:55.337213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c022e-7de6-46d0-a4d3-95d42056456f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:55.345742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:55.361637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 467/918] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:16:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:16:55.643986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ab7d1-f863-4f10-aaf3-f199f6b0219d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:55.644269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ab7d1-f863-4f10-aaf3-f199f6b0219d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:55.644542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ab7d1-f863-4f10-aaf3-f199f6b0219d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:55.645896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 452/919] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:55.651654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebd50-9edd-4032-bdcf-03da72f95f2c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:55.652112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebd50-9edd-4032-bdcf-03da72f95f2c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:55.652190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ebd50-9edd-4032-bdcf-03da72f95f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:55.671188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1d5ebd50-9edd-4032-bdcf-03da72f95f2c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:55.672432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1d5ebd50-9edd-4032-bdcf-03da72f95f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:55.749114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 468/920] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:16:56.017954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ab7d1-f863-4f10-aaf3-f199f6b0219d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:56.057200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:56.122502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08d822-a2c5-4c6c-9b4c-7e430904fff4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.122886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08d822-a2c5-4c6c-9b4c-7e430904fff4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.123049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08d822-a2c5-4c6c-9b4c-7e430904fff4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.124809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 469/921] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:56.130843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa289cef-1e11-44c5-949b-d7e7e9eccae0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.131126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa289cef-1e11-44c5-949b-d7e7e9eccae0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.131401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa289cef-1e11-44c5-949b-d7e7e9eccae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.131619 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ab7d1-f863-4f10-aaf3-f199f6b0219d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:56.150446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fa289cef-1e11-44c5-949b-d7e7e9eccae0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:56.151688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fa289cef-1e11-44c5-949b-d7e7e9eccae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:56.169455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:56.170909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.171192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.171472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.172301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:56.173697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:56.190866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:56.192877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:56.194478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 453/922] 10.222.0.18 () {56 vars in 1132 bytes} [Mon Sep 26 05:16:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:56.200676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:56.239640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 470/923] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:16:56.331688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:56.334884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a2f95-fd84-42ae-a64b-2db1a6614ac1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:56.370661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:56.371300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.371599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.371882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.372521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:56.372826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:56.374201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:56.379483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 454/924] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:56.385338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa289cef-1e11-44c5-949b-d7e7e9eccae0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:56.437522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:56.489915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa289cef-1e11-44c5-949b-d7e7e9eccae0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:56.513712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:56.525690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:56.526316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.526597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.526869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.527937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:56.528253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:56.529947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:56.536611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 471/925] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:56.542148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:56.634204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5f5db-70d3-4d1e-8efe-90b0c53a2a28 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:56.661676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8c8f3-dce0-4e2a-bb7e-a6d3d895eaf6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:56.675498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:56.676600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.677211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:56.678256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.678774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.679660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:56.681363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:56.693125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:56.694161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:16:56.695030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:56.703014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 455/926] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:16:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:16:56.704258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:56.706149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6b0a4-8743-4f03-8365-42f02820d4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:56.706776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b0a4-8743-4f03-8365-42f02820d4cb None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.707058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b0a4-8743-4f03-8365-42f02820d4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.707332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6b0a4-8743-4f03-8365-42f02820d4cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.708140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6b0a4-8743-4f03-8365-42f02820d4cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:56.709591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6b0a4-8743-4f03-8365-42f02820d4cb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:56.738063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 472/927] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:16:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:16:56.739393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c0e1-0b90-4df7-94b7-b6c42a51db9d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.739733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c0e1-0b90-4df7-94b7-b6c42a51db9d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.740008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45c0e1-0b90-4df7-94b7-b6c42a51db9d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.741496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 473/928] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:16:56.747854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e143102-bdef-478b-83c5-77ed22a65628 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.748166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e143102-bdef-478b-83c5-77ed22a65628 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.748290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:56.748450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e143102-bdef-478b-83c5-77ed22a65628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.768481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1e143102-bdef-478b-83c5-77ed22a65628 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:56.769704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1e143102-bdef-478b-83c5-77ed22a65628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:56.841877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c27c0d3-32c4-4356-98cb-287277f72c9d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:56.861103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 474/929] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:56.885019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:56.886268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:56.886847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:56.887438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:56.888445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:56.888989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:56.890615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:56.897259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 456/930] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:16:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:56.904035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e143102-bdef-478b-83c5-77ed22a65628 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.002790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:57.010493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e143102-bdef-478b-83c5-77ed22a65628 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:57.046511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:57.047388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.047704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.047975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.048613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:57.048923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:57.050320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:57.055432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 475/931] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:16:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:57.061628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.148342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.158383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:57.169011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6aaa25-347b-4ac3-bd88-33281f62c2dc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:57.207812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:57.209160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.209648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.210147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.211621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] RBAC: Adding query filter params (interface=public, service_id=7329a9397d244791ace0130237a9ed16, region_id=RegionOne) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:57.212145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:57.214362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:57.222822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 457/932] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:16:57 2022] GET /identity/v3/endpoints?service_id=7329a9397d244791ace0130237a9ed16&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:57.228441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.277173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81495d00-b7f6-45f3-b005-083363bedee3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:57.325519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:57.326561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.327225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.327734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.340930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:16:57.341217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471de7ee-435d-49bd-bd11-54e2523f3498 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:16:57.346441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:57.347380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:16:57.348293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:57.351137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 476/933] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 05:16:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:57.358481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.379941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:57.380600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.380943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.381219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.381885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:57.383269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:57.387333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:57.395748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 458/934] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:16:57 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:16:57.486436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a75c5-52f1-4811-bbdc-d07643ed914a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:57.525445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc164d-8f76-47f0-b09f-4e68a4f45f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:57.526468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc164d-8f76-47f0-b09f-4e68a4f45f07 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.526972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc164d-8f76-47f0-b09f-4e68a4f45f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.527733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc164d-8f76-47f0-b09f-4e68a4f45f07 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.528638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc164d-8f76-47f0-b09f-4e68a4f45f07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:57.529157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc164d-8f76-47f0-b09f-4e68a4f45f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:57.530802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc164d-8f76-47f0-b09f-4e68a4f45f07 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:57.541115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 477/935] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 05:16:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:57.547502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.573970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fdfe2-0298-47e1-a62b-b017e9bc630f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.575702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fdfe2-0298-47e1-a62b-b017e9bc630f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.575702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fdfe2-0298-47e1-a62b-b017e9bc630f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.577549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:57.577737 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 478/936] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:57.583953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d7197-18be-48da-97c9-6519ab9382be None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.584237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d7197-18be-48da-97c9-6519ab9382be None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.585355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d7197-18be-48da-97c9-6519ab9382be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.610321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1d8d7197-18be-48da-97c9-6519ab9382be None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:57.612113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1d8d7197-18be-48da-97c9-6519ab9382be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:57.676528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb6d70-cf02-435c-9bb1-74a90f259f97 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:57.709328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 479/937] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:16:57.715261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:57.716247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.716731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.717231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.729205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:57.731060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:57.746523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:57.747639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:57.748564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:57.748564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:57.748564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:57.750899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 459/938] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:57.757434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d7197-18be-48da-97c9-6519ab9382be None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.775161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:57.863339 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d7197-18be-48da-97c9-6519ab9382be None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:57.898638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:57.899627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:57.900111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:57.900602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:57.901512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:57.902038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:57.903703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:57.916040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 480/939] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:57.922117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.984237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:57.999473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:58.031792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98278da-8685-4d9c-8f21-147dc697ecb8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.069819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.070456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.070772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.071054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.084496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.085126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:58.086638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:16:58.101922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:58.102924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:16:58.103918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:58.104457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107d614-8e0e-4039-97a5-091b55761e12 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.107708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 460/940] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:16:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:58.109699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:58.150944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.151699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.151989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.152348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.153022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.155244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.158808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING keystone.server.flask.common [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 05:16:58.181759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.sql.core [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 05:16:58.181759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 05:16:58.181759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [parameters: {'id': '8c55afb2e5574564931878a6918be000', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 05:16:58.181759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81593) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c55afb2e5574564931878a6918be000.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c55afb2e5574564931878a6918be000. Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:16:58.203702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result.read() Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 26 05:16:58.204601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application yield resource Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise self.value Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application session.commit() Sep 26 05:16:58.205541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.session.flush() Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application compat.raise_( Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 05:16:58.206427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 05:16:58.207320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result.read() Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:16:58.208166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [parameters: {'id': '8c55afb2e5574564931878a6918be000', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.209030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:58.209807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c55afb2e5574564931878a6918be000. Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.210762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 481/941] 10.222.0.18 () {60 vars in 1140 bytes} [Mon Sep 26 05:16:57 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:58.219567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:58.221615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68925c-6206-487b-8705-ebd9e5881a4e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.261896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.262433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.262905 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.263244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.264144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:58.264516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.266081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.269322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:58.298366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 461/942] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 05:16:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:16:58.303321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:58.336897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b461b-e9a7-4fac-8737-17401594cde8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.367868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:58.380267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.381047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.381384 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.381659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.389799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.391636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:58.404165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:58.405104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.406023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 482/943] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:58.413580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:58.437601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596fd2a-568e-4b64-b46d-10e557b7684b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.478844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338393-8499-45b8-9786-b721d71af639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.480620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338393-8499-45b8-9786-b721d71af639 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.481358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338393-8499-45b8-9786-b721d71af639 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.482076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338393-8499-45b8-9786-b721d71af639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.497052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338393-8499-45b8-9786-b721d71af639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.500017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338393-8499-45b8-9786-b721d71af639 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-48338393-8499-45b8-9786-b721d71af639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:16:58.519535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:58.520547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:16:58.521474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:16:58.521474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:16:58.521474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:16:58.528849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 462/944] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:58.530304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338393-8499-45b8-9786-b721d71af639 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:58.539338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a81307-6d35-4d92-9df7-49fceb3c2446 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.576882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.577670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.578047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.578416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.579181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:58.579515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:58.579699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.581632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.609924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 483/945] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:58.652034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338393-8499-45b8-9786-b721d71af639 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.692810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.693438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.693712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.693981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.694705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:58.695008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.696421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.710616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 463/946] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:58.716719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:58.772589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:58.829135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd560bcf-9705-4cc0-bebf-b68d174759c2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:58.868161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a75d1-18f1-4aba-a386-3af0b083d2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:58.869161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a75d1-18f1-4aba-a386-3af0b083d2cf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:58.869644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a75d1-18f1-4aba-a386-3af0b083d2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:58.870117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a75d1-18f1-4aba-a386-3af0b083d2cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:58.881891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a75d1-18f1-4aba-a386-3af0b083d2cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:58.883684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a75d1-18f1-4aba-a386-3af0b083d2cf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-814a75d1-18f1-4aba-a386-3af0b083d2cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:16:58.898029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:58.899027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:16:58.900091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:58.902715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 484/947] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:58.908955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:59.022754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa76e4e-61ca-43d0-a41d-b18e6656e3e0 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:59.024204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:59.055302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c50373-334f-4ace-b418-7be8509e2436 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.055667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c50373-334f-4ace-b418-7be8509e2436 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.055880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c50373-334f-4ace-b418-7be8509e2436 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.057474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 485/948] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:59.059744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:59.060363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.060639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.060912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.061672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:59.061980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:59.062551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0729-95e7-43f9-b87a-d0bd7dd89479 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.063175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0729-95e7-43f9-b87a-d0bd7dd89479 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.063445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f0729-95e7-43f9-b87a-d0bd7dd89479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.063789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:59.077728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 464/949] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:59.082199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4b3f0729-95e7-43f9-b87a-d0bd7dd89479 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:59.083808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4b3f0729-95e7-43f9-b87a-d0bd7dd89479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:59.087660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:59.158329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 486/950] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:16:59.204982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62509a5-fde6-482d-969e-c1b709ac956b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:59.250990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:59.251704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.251982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.252249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/8bd38706158a47d8b0ff2b48b0fe082a/roles/b9183d1fb23548d3b90a5b072fc9b91e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.254758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=8bd38706158a47d8b0ff2b48b0fe082a, role_id=b9183d1fb23548d3b90a5b072fc9b91e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:59.256414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:59.279463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 465/951] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:16:59 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/8bd38706158a47d8b0ff2b48b0fe082a/roles/b9183d1fb23548d3b90a5b072fc9b91e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:16:59.443162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0729-95e7-43f9-b87a-d0bd7dd89479 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:59.485997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:59.552633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f0729-95e7-43f9-b87a-d0bd7dd89479 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:59.590400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0558a-f942-4a64-9195-c68c109e7bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:59.591045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0558a-f942-4a64-9195-c68c109e7bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.591327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0558a-f942-4a64-9195-c68c109e7bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.591623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0558a-f942-4a64-9195-c68c109e7bd1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.592218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0558a-f942-4a64-9195-c68c109e7bd1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:59.593593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0558a-f942-4a64-9195-c68c109e7bd1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-bcd0558a-f942-4a64-9195-c68c109e7bd1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:16:59.602598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:16:59.603627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:16:59.604648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 487/952] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:16:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:16:59.610200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:59.636429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:59.662105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0f49-ce27-4d13-b152-efa158f72300 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.662477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0f49-ce27-4d13-b152-efa158f72300 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.662662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0f49-ce27-4d13-b152-efa158f72300 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.664318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 488/953] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:16:59.670055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8186bb7-8df4-436a-940c-0fcdea9c4c17 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.670627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8186bb7-8df4-436a-940c-0fcdea9c4c17 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.671060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8186bb7-8df4-436a-940c-0fcdea9c4c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.693368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b8186bb7-8df4-436a-940c-0fcdea9c4c17 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:16:59.694810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b8186bb7-8df4-436a-940c-0fcdea9c4c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:16:59.727018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340847d-5fd2-4ced-93dd-24695a63917a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:59.768101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:59.769251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.769917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.770342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.771236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:59.771673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:59.773761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:59.787566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 466/954] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:16:59.787566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:16:59.788122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 489/955] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:16:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:16:59.874374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:16:59.889725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a7456a-97c9-4020-ad9f-03309c35c7f4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:16:59.924548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:16:59.925166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:16:59.925447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:16:59.925722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:16:59.926355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:16:59.926662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:16:59.928073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:16:59.933018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 467/956] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:16:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:00.049099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8186bb7-8df4-436a-940c-0fcdea9c4c17 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:00.082952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:00.160957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8186bb7-8df4-436a-940c-0fcdea9c4c17 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:00.197373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:00.198019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:00.198301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:00.198574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:00.199241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:00.200799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:00.209636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:00.210666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:00.211521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 490/957] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:17:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:00.218814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:00.327439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3a4f1-1632-4fb5-8c08-2ae39577a206 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:00.362401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:00.363009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:00.363285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:00.363572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:00.364207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:00.364514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:00.366011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:00.371214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 468/958] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:17:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:00.376847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:00.475299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:00.481908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40084f7-1a1e-4f91-bae5-911301b5975b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:00.515840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53979249-a32b-41ac-a4b4-6ba3a45fc237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:00.516845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979249-a32b-41ac-a4b4-6ba3a45fc237 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:00.517329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979249-a32b-41ac-a4b4-6ba3a45fc237 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:00.517802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53979249-a32b-41ac-a4b4-6ba3a45fc237 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:00.518641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979249-a32b-41ac-a4b4-6ba3a45fc237 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:00.519147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979249-a32b-41ac-a4b4-6ba3a45fc237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:00.520773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53979249-a32b-41ac-a4b4-6ba3a45fc237 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:00.526498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 491/959] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:17:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:00.532480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:00.550363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:00.637555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe647000-51c9-41e2-a6fd-b7e3d86af9af None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:00.674274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eb07e-e7f4-4047-9386-778e2a8469ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:00.674888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb07e-e7f4-4047-9386-778e2a8469ce None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:00.675162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb07e-e7f4-4047-9386-778e2a8469ce None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:00.675425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eb07e-e7f4-4047-9386-778e2a8469ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:00.676137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eb07e-e7f4-4047-9386-778e2a8469ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:00.677502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eb07e-e7f4-4047-9386-778e2a8469ce None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:00.703444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 469/960] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:17:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:17:01.065956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dc30-b791-48aa-9d6d-0c6808691671 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:01.066533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dc30-b791-48aa-9d6d-0c6808691671 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:01.066533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dc30-b791-48aa-9d6d-0c6808691671 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:01.068214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 492/961] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:01.073554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294f41-f33a-44c5-8162-da9b34860fc8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:01.073849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294f41-f33a-44c5-8162-da9b34860fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:01.074370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294f41-f33a-44c5-8162-da9b34860fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:01.094073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-60294f41-f33a-44c5-8162-da9b34860fc8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:01.095270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-60294f41-f33a-44c5-8162-da9b34860fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:01.162880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:01.175039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 470/962] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:01.455761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031dc30-b791-48aa-9d6d-0c6808691671 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:01.568013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031dc30-b791-48aa-9d6d-0c6808691671 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:01.601142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca30ecd-6aa8-40c9-b910-935b4fa1bb51 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:01.601724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca30ecd-6aa8-40c9-b910-935b4fa1bb51 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:01.601724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca30ecd-6aa8-40c9-b910-935b4fa1bb51 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:01.602709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:01.603249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 471/963] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:01.603352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:01.604602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:01.604602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:01.604602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:01.606154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:01.610155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d636-c8c6-47fc-8d86-09c453c503a3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:01.610447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d636-c8c6-47fc-8d86-09c453c503a3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:01.610725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337d636-c8c6-47fc-8d86-09c453c503a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:01.624973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.sql.core [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 05:17:01.624973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 05:17:01.624973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [parameters: {'user_id': '92acca7fead64fce80cdb41ddc2f2420', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 05:17:01.624973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81593) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result.read() Sep 26 05:17:01.632205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:17:01.633336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application yield resource Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise self.value Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application session.commit() Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 05:17:01.634542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.session.flush() Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application compat.raise_( Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 05:17:01.635709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:17:01.636955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application result.read() Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:17:01.637955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [parameters: {'user_id': '92acca7fead64fce80cdb41ddc2f2420', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:01.638995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 26 05:17:01.640033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 26 05:17:01.641195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 26 05:17:01.641195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 26 05:17:01.641195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 05:17:01.641195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 05:17:01.641195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 05:17:01.641195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:01.641603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c337d636-c8c6-47fc-8d86-09c453c503a3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:01.643465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c337d636-c8c6-47fc-8d86-09c453c503a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:01.648570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 493/964] 10.222.0.18 () {60 vars in 1131 bytes} [Mon Sep 26 05:17:01 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:01.653215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:01.679375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:01.734927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 472/965] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:01.766455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92521d8-b419-4202-bf7c-b44c28fff8a6 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:01.802586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:01.803223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:01.803567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:01.803860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:01.811462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:01.813477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:17:01.837311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:01.838315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:01.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 494/966] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:17:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:01.844806 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d636-c8c6-47fc-8d86-09c453c503a3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:01.954257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337d636-c8c6-47fc-8d86-09c453c503a3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:01.981669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:01.996981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a31d01-b8e8-49db-a8fc-ddeb06b9d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:01.997562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31d01-b8e8-49db-a8fc-ddeb06b9d2ff None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:01.997842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31d01-b8e8-49db-a8fc-ddeb06b9d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:01.998119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a31d01-b8e8-49db-a8fc-ddeb06b9d2ff None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:01.998853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a31d01-b8e8-49db-a8fc-ddeb06b9d2ff None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:01.999158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a31d01-b8e8-49db-a8fc-ddeb06b9d2ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:02.003584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a31d01-b8e8-49db-a8fc-ddeb06b9d2ff None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:02.034764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:02.045970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 473/967] 10.222.0.18 () {56 vars in 1101 bytes} [Mon Sep 26 05:17:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:02.139403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:02.160791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526a3e8-7c6c-4c69-a970-2d1dcbb73ecc None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:02.201003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:02.201930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.202393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.202808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.215846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:02.217914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109b821-8282-406f-b91c-a717b6d49580 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.218203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109b821-8282-406f-b91c-a717b6d49580 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.218479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109b821-8282-406f-b91c-a717b6d49580 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.220117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 474/968] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:02.222681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:02.223855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:02.224838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:02.225830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 495/969] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 05:17:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:02.225937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44f6e-7fd2-4c8e-afd4-734e937c5aab None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.226217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44f6e-7fd2-4c8e-afd4-734e937c5aab None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.226494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb44f6e-7fd2-4c8e-afd4-734e937c5aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.235762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:02.249945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fdb44f6e-7fd2-4c8e-afd4-734e937c5aab None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:02.251084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fdb44f6e-7fd2-4c8e-afd4-734e937c5aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:02.359000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 475/970] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:02.367875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28418c97-48d8-4f59-84cf-9918e7fa3a65 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:02.403675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:02.404567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.404995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.405416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.406222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:02.406684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:02.408330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:02.420667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 496/971] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 05:17:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:02.426354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44f6e-7fd2-4c8e-afd4-734e937c5aab None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:02.530766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb44f6e-7fd2-4c8e-afd4-734e937c5aab None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:02.545135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:02.566803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:02.567454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.567764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.568041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.578808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:02.580304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:02.595375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:02.596389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:02.597288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:02.597288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:02.597288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:02.599916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 476/972] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:02.602458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:02.607786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:02.628203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:02.718600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86412c00-f781-488d-8a06-06bfa1514764 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:02.742451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b72c8-9a76-4267-bd69-1a197747ec10 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:02.755402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:02.756067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.756350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.756617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.757264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:02.757567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:02.758930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:02.771158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 497/973] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:02.776807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:02.780108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d2b2b-e1b1-44dd-9750-43a2857b7786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:02.780722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2b2b-e1b1-44dd-9750-43a2857b7786 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.781052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2b2b-e1b1-44dd-9750-43a2857b7786 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.781269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d2b2b-e1b1-44dd-9750-43a2857b7786 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.781922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d2b2b-e1b1-44dd-9750-43a2857b7786 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:02.783300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d2b2b-e1b1-44dd-9750-43a2857b7786 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:02.800000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 477/974] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:17:02 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:17:02.851425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:02.897161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51d04-4fe4-4537-aa12-8167234d6c2b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:02.942688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:02.943326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.943637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.943905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.952959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:02.954734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:02.956345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e093-b2c9-470b-b09f-7131aaf35f12 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.956597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e093-b2c9-470b-b09f-7131aaf35f12 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.956871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7e093-b2c9-470b-b09f-7131aaf35f12 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.958233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 478/975] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:17:02.964031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c70cf-a5a2-4b0e-891b-0da177416a9a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:02.964380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c70cf-a5a2-4b0e-891b-0da177416a9a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:02.964579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c70cf-a5a2-4b0e-891b-0da177416a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:17:02.968662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:02.969805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:17:02.970768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:02.971757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 498/976] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:17:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:02.975912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:02.988356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-690c70cf-a5a2-4b0e-891b-0da177416a9a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:02.989764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-690c70cf-a5a2-4b0e-891b-0da177416a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:03.015226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:03.066799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 479/977] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:17:03.084447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b02085-85c6-41bb-acd7-a12f417e023a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.104923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:03.119711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.120322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.120595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.120924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.121652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:03.121954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.123376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.141617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 499/978] 10.222.0.18 () {56 vars in 1149 bytes} [Mon Sep 26 05:17:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:03.147440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c70cf-a5a2-4b0e-891b-0da177416a9a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.249968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c70cf-a5a2-4b0e-891b-0da177416a9a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.288033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.288662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.288937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.289203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.319474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:03.329717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.366512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.368005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.434610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5db12d-9cba-4416-84f5-21c0e13f5a61 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.470379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 480/979] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:03.476049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.477520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.478210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.478491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.479513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.479513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.480783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:03.490052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:03.491246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:03.492133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 500/980] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:03.497894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.537552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:03.544020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:03.583152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a25ed-0043-4535-ba02-3e891d4517ff None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.606049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f4446-ae6e-48ab-97d4-e0282cae377e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.617128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.617767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.618044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.618315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.628302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.629749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.640718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.641337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.641611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.641880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.642509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:03.642813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.644193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:03.644287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:03.645164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:03.646041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:03.646041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:03.646041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:03.646041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 481/981] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:03.650858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 501/982] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:03.651617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.656402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.759858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439fed-b88b-440a-8d99-34dc8f90f09f None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.762472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b438d97-7574-4be3-a797-65eafa5856f9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.769487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:03.769969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:03.797035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.797930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.798382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.798496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.798909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.799062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.799346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.799658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.800123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:03.800300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:03.800605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.800859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.801986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.802510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.807883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 502/983] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:03.813719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.814885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 482/984] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:03.820353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.915700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d616-8c15-4c58-b7f4-334f04f79dee None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.922349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145c08-f399-4398-af4f-029efedce797 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:03.951932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.952569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.952848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.953126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.957038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:03.957648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:03.957921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:03.958188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:03.958899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] RBAC: Adding query filter params (interface=admin, service_id=7329a9397d244791ace0130237a9ed16, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:03.959200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.960273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:03.960588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.961761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:03.966386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 503/985] 10.222.0.18 () {56 vars in 1249 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/endpoints?service_id=7329a9397d244791ace0130237a9ed16&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:03.971960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:17:03.973935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:03.974870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:03.975888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 483/986] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:03.987073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:04.010224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:04.016667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:04.079305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c6d0dd-8e29-4ab2-845b-61fe85858e1b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:04.094013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c281fd-3c6d-4d2c-97db-d2881abefa44 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:04.114429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:04.115244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:04.115521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:04.115816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:04.116422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:04.117774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:04.124199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 504/987] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:17:04.134229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f25718-450a-4c28-ae5e-ce7464b0acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:04.135185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25718-450a-4c28-ae5e-ce7464b0acdf None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:04.135702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25718-450a-4c28-ae5e-ce7464b0acdf None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:04.136143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f25718-450a-4c28-ae5e-ce7464b0acdf None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:04.137328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25718-450a-4c28-ae5e-ce7464b0acdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:04.137886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25718-450a-4c28-ae5e-ce7464b0acdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:04.139535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f25718-450a-4c28-ae5e-ce7464b0acdf None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:04.154558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 484/988] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:04.160563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:04.271524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:04.276609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a54bc-310c-4d5a-b18f-f7723ae55864 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:04.321800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63237c-e0c1-483c-ae57-d9fc5d1fdfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:04.322417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63237c-e0c1-483c-ae57-d9fc5d1fdfbf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:04.322685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63237c-e0c1-483c-ae57-d9fc5d1fdfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:04.322961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63237c-e0c1-483c-ae57-d9fc5d1fdfbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:04.323719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63237c-e0c1-483c-ae57-d9fc5d1fdfbf None admin] RBAC: Adding query filter params (role.id=b9183d1fb23548d3b90a5b072fc9b91e, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=8bd38706158a47d8b0ff2b48b0fe082a) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:04.324172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63237c-e0c1-483c-ae57-d9fc5d1fdfbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:04.325616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63237c-e0c1-483c-ae57-d9fc5d1fdfbf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:04.331507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 505/989] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:04 2022] GET /identity/v3/role_assignments?user.id=8bd38706158a47d8b0ff2b48b0fe082a&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=b9183d1fb23548d3b90a5b072fc9b91e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:04.977877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1904acd-b99f-432b-9600-50390b324bb1 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:04.978442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1904acd-b99f-432b-9600-50390b324bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:04.978442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1904acd-b99f-432b-9600-50390b324bb1 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:04.979942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 485/990] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:04.985453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94ac7-b388-4142-b91b-ab0aa12de72a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:04.985712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94ac7-b388-4142-b91b-ab0aa12de72a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:04.986013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff94ac7-b388-4142-b91b-ab0aa12de72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:05.004880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-aff94ac7-b388-4142-b91b-ab0aa12de72a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:05.006411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-aff94ac7-b388-4142-b91b-ab0aa12de72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:05.075768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 506/991] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:05.338510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1904acd-b99f-432b-9600-50390b324bb1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:05.434572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:05.450233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1904acd-b99f-432b-9600-50390b324bb1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:05.486025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:05.486667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:05.486957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:05.487223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:05.487820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:05.489192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:05.498888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:05.500152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:05.501004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 486/992] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:17:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:05.508910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94ac7-b388-4142-b91b-ab0aa12de72a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:05.604375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:05.614394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff94ac7-b388-4142-b91b-ab0aa12de72a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:05.650675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:05.651267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:05.651596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:05.651871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:05.653071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:05.653382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:05.654749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:05.659829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 507/993] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:17:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:05.665390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:05.771879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45923f7-c1a1-4912-8ac6-909570b27d85 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:05.806549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:05.807201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:05.807480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:05.807778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:05.809017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:05.809479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:05.810853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:05.819713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 487/994] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:17:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:05.822303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:05.925902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1285fe5-c3dd-4492-974d-35041a80e25c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:05.960367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419245ff-fac8-43c0-8cee-44aa1ec6afdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:05.960984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419245ff-fac8-43c0-8cee-44aa1ec6afdf None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:05.961261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419245ff-fac8-43c0-8cee-44aa1ec6afdf None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:05.961529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419245ff-fac8-43c0-8cee-44aa1ec6afdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:05.962228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419245ff-fac8-43c0-8cee-44aa1ec6afdf None admin] RBAC: Adding query filter params (interface=public, service_id=868aeaadf7cd44939ab4b7fcc43c678d, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:05.962535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419245ff-fac8-43c0-8cee-44aa1ec6afdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:05.963923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419245ff-fac8-43c0-8cee-44aa1ec6afdf None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:05.969445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 508/995] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:17:05 2022] GET /identity/v3/endpoints?service_id=868aeaadf7cd44939ab4b7fcc43c678d&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:05.975075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:05.995054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:06.084654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c870c9-30f5-421c-b985-572b4b77176b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:06.120666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a0085-b74e-47dc-bf2b-2a43518671df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:06.121274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a0085-b74e-47dc-bf2b-2a43518671df None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:06.121550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a0085-b74e-47dc-bf2b-2a43518671df None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:06.121828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a0085-b74e-47dc-bf2b-2a43518671df None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:06.122436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a0085-b74e-47dc-bf2b-2a43518671df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:06.123829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a0085-b74e-47dc-bf2b-2a43518671df None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:06.130525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 488/996] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:17:05 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:17:06.358134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418ab5e-634e-46f1-86bb-59b73d5eca8a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:06.358397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418ab5e-634e-46f1-86bb-59b73d5eca8a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:06.358652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418ab5e-634e-46f1-86bb-59b73d5eca8a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:06.360084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 509/997] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:06.366368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1b02-51c8-47d5-99c4-7aad6772862e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:06.366835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1b02-51c8-47d5-99c4-7aad6772862e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:06.367172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a1b02-51c8-47d5-99c4-7aad6772862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:06.387509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-326a1b02-51c8-47d5-99c4-7aad6772862e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:06.388780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-326a1b02-51c8-47d5-99c4-7aad6772862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:06.459101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 489/998] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:06.482397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf245d-52d3-498f-8de1-6a3fbae65a9a None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:06.482736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf245d-52d3-498f-8de1-6a3fbae65a9a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:06.482975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf245d-52d3-498f-8de1-6a3fbae65a9a None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:06.484503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 510/999] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:17:06.489736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46416-4e19-4092-bcf8-35d1c637c0aa None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:06.490002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46416-4e19-4092-bcf8-35d1c637c0aa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:06.490294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a46416-4e19-4092-bcf8-35d1c637c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:06.509043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f7a46416-4e19-4092-bcf8-35d1c637c0aa None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:06.510213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f7a46416-4e19-4092-bcf8-35d1c637c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:06.513326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:06.583119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 490/1000] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:17:06.724312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf245d-52d3-498f-8de1-6a3fbae65a9a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:06.748010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:06.836374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf245d-52d3-498f-8de1-6a3fbae65a9a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:06.843210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a46416-4e19-4092-bcf8-35d1c637c0aa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:06.877084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:06.877721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:06.877996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:06.878264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:06.878844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:06.880224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:06.890187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:06.891193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:06.892081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 511/1001] 10.222.0.18 () {56 vars in 1126 bytes} [Mon Sep 26 05:17:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:06.897470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:06.960656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a46416-4e19-4092-bcf8-35d1c637c0aa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:06.990974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:06.998460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:06.999179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:06.999406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:06.999712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] PATH_INFO: `/v3/services/image` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:07.000321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:07.001760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:07.011270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02d6ec-89bd-4633-848f-f8d2bdbebe49 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:07.012534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:07.013626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:07.015074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 491/1002] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Sep 26 05:17:06 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:07.019570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:07.024425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:07.050283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:07.050899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:07.051181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:07.051609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:07.052243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:07.052551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:07.053918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:07.059201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 512/1003] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:17:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:07.066240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:07.131695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35a804-6fdf-43ea-b468-14697d267411 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:07.166009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcecf4-5608-4adf-9156-87096f522e03 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:07.169301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:07.170073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:07.170507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:07.170916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:07.171718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] RBAC: Adding query filter params (name=image) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:07.172159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:07.173778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:07.179078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 492/1004] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:07.184724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:07.200292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:07.200902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:07.201184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:07.201458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:07.202085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:07.202394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:07.203813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:07.213355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 513/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Mon Sep 26 05:17:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:07.215218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:07.231327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:07.259411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:07.307292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357e892-6b53-4327-891f-61f607f3e868 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:07.327296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08ef49-7a80-4add-a1a8-260a86334dfb None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:07.346709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39558b66-83a2-4524-9013-1a7bd987605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:07.347304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558b66-83a2-4524-9013-1a7bd987605a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:07.347613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558b66-83a2-4524-9013-1a7bd987605a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:07.347897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558b66-83a2-4524-9013-1a7bd987605a None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:07.348531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39558b66-83a2-4524-9013-1a7bd987605a None admin] RBAC: Adding query filter params (type=image) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:07.348834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39558b66-83a2-4524-9013-1a7bd987605a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:07.350228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39558b66-83a2-4524-9013-1a7bd987605a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:07.354941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 493/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:07.364373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bf824-fa3f-49c2-96d7-f86618453cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:07.365012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf824-fa3f-49c2-96d7-f86618453cc7 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:07.365289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf824-fa3f-49c2-96d7-f86618453cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:07.365560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bf824-fa3f-49c2-96d7-f86618453cc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:07.366248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf824-fa3f-49c2-96d7-f86618453cc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:07.367700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bf824-fa3f-49c2-96d7-f86618453cc7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:07.389457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 514/1007] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:17:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:17:08.286811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842ed82-fc6b-4254-9e49-84fee45a3b67 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:08.287325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842ed82-fc6b-4254-9e49-84fee45a3b67 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:08.287496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842ed82-fc6b-4254-9e49-84fee45a3b67 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:08.288788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 494/1008] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:08.297630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb570-a68a-4015-a1e9-22c73064fcfd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:08.297630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb570-a68a-4015-a1e9-22c73064fcfd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:08.297630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4eb570-a68a-4015-a1e9-22c73064fcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:08.315131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ff4eb570-a68a-4015-a1e9-22c73064fcfd None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:08.316367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ff4eb570-a68a-4015-a1e9-22c73064fcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:08.387585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:08.395714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 515/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:08.657420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842ed82-fc6b-4254-9e49-84fee45a3b67 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:08.769513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842ed82-fc6b-4254-9e49-84fee45a3b67 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:08.799851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:08.805742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:08.806373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:08.806634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:08.806918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:08.807497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:08.808938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:08.818110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:08.819141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:17:08.820055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:08.823909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 495/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:17:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:08.825304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb570-a68a-4015-a1e9-22c73064fcfd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:08.927468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4eb570-a68a-4015-a1e9-22c73064fcfd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:08.962533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:08.963439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:08.963919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:08.964437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:08.965381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:08.965878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:08.967416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:08.975735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 516/1011] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:17:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:08.978620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:09.089531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c58bd-6829-42c6-8c77-66419cd3821a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:09.127091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17202bf0-51c6-4a22-aa0a-1711b552fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:09.128076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202bf0-51c6-4a22-aa0a-1711b552fa2a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:09.128532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202bf0-51c6-4a22-aa0a-1711b552fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:09.128976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17202bf0-51c6-4a22-aa0a-1711b552fa2a None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:09.129782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17202bf0-51c6-4a22-aa0a-1711b552fa2a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:09.130274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17202bf0-51c6-4a22-aa0a-1711b552fa2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:09.131844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17202bf0-51c6-4a22-aa0a-1711b552fa2a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:09.137440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 496/1012] 10.222.0.18 () {56 vars in 1112 bytes} [Mon Sep 26 05:17:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:09.143283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:09.207856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:09.252028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c934c9-09d0-4c6a-ac33-af766b711b14 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:09.295229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4e01-96f5-4b15-a399-3f3269fcec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:09.296165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4e01-96f5-4b15-a399-3f3269fcec30 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:09.296678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4e01-96f5-4b15-a399-3f3269fcec30 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:09.297154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4e01-96f5-4b15-a399-3f3269fcec30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:09.298111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c4e01-96f5-4b15-a399-3f3269fcec30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:09.300121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c4e01-96f5-4b15-a399-3f3269fcec30 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:09.324293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 517/1013] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:17:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:17:09.507266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28efc5-7afc-4c74-858a-29d66bba72e9 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:09.507820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28efc5-7afc-4c74-858a-29d66bba72e9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:09.507820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28efc5-7afc-4c74-858a-29d66bba72e9 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:09.509256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 497/1014] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:09.515173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4bef0-e6b7-4e15-8c28-f06394813923 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:09.515462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4bef0-e6b7-4e15-8c28-f06394813923 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:09.515724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4bef0-e6b7-4e15-8c28-f06394813923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:09.535173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d3f4bef0-e6b7-4e15-8c28-f06394813923 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:09.536454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d3f4bef0-e6b7-4e15-8c28-f06394813923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:09.618614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 518/1015] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:09 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:09.672063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef3b2-0e90-40e6-83e7-17d55c38c0b2 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:09.672405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef3b2-0e90-40e6-83e7-17d55c38c0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:09.672609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef3b2-0e90-40e6-83e7-17d55c38c0b2 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:09.674576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 498/1016] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:09.679735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb012dd-a559-4950-9045-795e2aa5a0d5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:09.680022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb012dd-a559-4950-9045-795e2aa5a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:09.680289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb012dd-a559-4950-9045-795e2aa5a0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:09.698927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4eb012dd-a559-4950-9045-795e2aa5a0d5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:09.700383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4eb012dd-a559-4950-9045-795e2aa5a0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:09.742044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:09.772235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 519/1017] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:09 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:09.887043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef3b2-0e90-40e6-83e7-17d55c38c0b2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:09.951029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:09.994338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef3b2-0e90-40e6-83e7-17d55c38c0b2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:10.030375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:10.030897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:10.031172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:10.031441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:10.032121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:10.033549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:10.050946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 499/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:17:09 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:17:10.078824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb012dd-a559-4950-9045-795e2aa5a0d5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:10.194112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb012dd-a559-4950-9045-795e2aa5a0d5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:10.240621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9141262-0569-4c1c-ab91-97b14ec92c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:10.241283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141262-0569-4c1c-ab91-97b14ec92c94 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:10.241553 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141262-0569-4c1c-ab91-97b14ec92c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:10.241819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9141262-0569-4c1c-ab91-97b14ec92c94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:10.242911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141262-0569-4c1c-ab91-97b14ec92c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:10.244360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9141262-0569-4c1c-ab91-97b14ec92c94 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:10.246344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 520/1019] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:10.252394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:10.362627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521591-fb74-4a16-bf4d-c3d1c3762a30 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:10.383527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:10.404780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91f393-bf60-4835-bd97-24b8f935513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:10.405436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f393-bf60-4835-bd97-24b8f935513b None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:10.405693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f393-bf60-4835-bd97-24b8f935513b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:10.405981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91f393-bf60-4835-bd97-24b8f935513b None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:10.406640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91f393-bf60-4835-bd97-24b8f935513b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:10.408103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91f393-bf60-4835-bd97-24b8f935513b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:10.438108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 500/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:17:10 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:17:11.595138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181cd26-1dc2-4cfd-853c-e7cc9b85f1ba None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:11.595690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181cd26-1dc2-4cfd-853c-e7cc9b85f1ba None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:11.595690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181cd26-1dc2-4cfd-853c-e7cc9b85f1ba None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:11.597126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 521/1021] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:11.602249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465f5f-5fac-42ee-8705-cda0aa12741e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:11.602682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465f5f-5fac-42ee-8705-cda0aa12741e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:11.602762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465f5f-5fac-42ee-8705-cda0aa12741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:11.621125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c0465f5f-5fac-42ee-8705-cda0aa12741e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:11.622344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c0465f5f-5fac-42ee-8705-cda0aa12741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:11.696889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 501/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:11.961152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181cd26-1dc2-4cfd-853c-e7cc9b85f1ba None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.005540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:12.076540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181cd26-1dc2-4cfd-853c-e7cc9b85f1ba None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.114601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9833728-8abd-4589-a115-1799cd2502c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:12.115345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833728-8abd-4589-a115-1799cd2502c5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.115618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833728-8abd-4589-a115-1799cd2502c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.115913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9833728-8abd-4589-a115-1799cd2502c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.129000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9833728-8abd-4589-a115-1799cd2502c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d9833728-8abd-4589-a115-1799cd2502c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:12.133911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:12.135023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:12.140591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 522/1023] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 05:17:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:12.142788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465f5f-5fac-42ee-8705-cda0aa12741e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.232080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9edc17-eb51-49e9-aa57-cb24429074b1 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.232293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9edc17-eb51-49e9-aa57-cb24429074b1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.232494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9edc17-eb51-49e9-aa57-cb24429074b1 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.233992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 523/1024] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:17:12.239789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49605085-33b4-4722-9c10-bd48875d7bc4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.240272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49605085-33b4-4722-9c10-bd48875d7bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.240542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49605085-33b4-4722-9c10-bd48875d7bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.257906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465f5f-5fac-42ee-8705-cda0aa12741e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.259376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-49605085-33b4-4722-9c10-bd48875d7bc4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:12.259529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:12.260591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-49605085-33b4-4722-9c10-bd48875d7bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:12.300920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:12.301559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.301829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.302122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.302792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:12.303101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:12.304543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:12.313879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 502/1025] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:12.319309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.337759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 524/1026] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:17:12.423525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b6d2c-7bf0-49ac-bc26-d0e4746dded1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.458214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:12.458841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.459162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.459432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.474613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:12.476217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:12.490990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:12.497398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:12.498351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:12.498351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:12.498351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:12.498351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 503/1027] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:12.498612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49605085-33b4-4722-9c10-bd48875d7bc4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.530608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:12.605113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.611821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49605085-33b4-4722-9c10-bd48875d7bc4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.624957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:12.646462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7fa95-4f43-4187-b0c8-4248bfecf612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:12.647079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7fa95-4f43-4187-b0c8-4248bfecf612 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.647361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7fa95-4f43-4187-b0c8-4248bfecf612 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.647678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7fa95-4f43-4187-b0c8-4248bfecf612 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.648349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7fa95-4f43-4187-b0c8-4248bfecf612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:12.648654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7fa95-4f43-4187-b0c8-4248bfecf612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:12.650006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7fa95-4f43-4187-b0c8-4248bfecf612 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:12.662071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 525/1028] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:12.663393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee99f9-62fd-4aae-961a-c481c8c0f04b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.663705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee99f9-62fd-4aae-961a-c481c8c0f04b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.663977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee99f9-62fd-4aae-961a-c481c8c0f04b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.665153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 526/1029] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:12.667580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee99f9-62fd-4aae-961a-c481c8c0f04b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.714634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d652c-8105-4ddc-a103-8201d755b1fa None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.748348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7632429b-674a-492d-8957-3fdcb6986379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:12.748900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632429b-674a-492d-8957-3fdcb6986379 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.749175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632429b-674a-492d-8957-3fdcb6986379 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.749443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7632429b-674a-492d-8957-3fdcb6986379 None admin] PATH_INFO: `/v3/services/image` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.750018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632429b-674a-492d-8957-3fdcb6986379 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:12.751400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7632429b-674a-492d-8957-3fdcb6986379 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:12.754421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7632429b-674a-492d-8957-3fdcb6986379 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:12.760225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:12.761468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:12.762371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 504/1030] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:12.763170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481797d-a90e-4d8b-a05f-cf516ec37512 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.763170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481797d-a90e-4d8b-a05f-cf516ec37512 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.763170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481797d-a90e-4d8b-a05f-cf516ec37512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.772996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee99f9-62fd-4aae-961a-c481c8c0f04b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.781407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6481797d-a90e-4d8b-a05f-cf516ec37512 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:12.782611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6481797d-a90e-4d8b-a05f-cf516ec37512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:12.806118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:12.806749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.807026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.807299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.814676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:12.816144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:17:12.827629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:12.828591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 527/1031] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:12.829534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.856151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 505/1032] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:12.857336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481797d-a90e-4d8b-a05f-cf516ec37512 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:12.869850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:12.939562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266d04-a9f8-47e9-94cd-08ae27f64437 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.964089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481797d-a90e-4d8b-a05f-cf516ec37512 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:12.975875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:12.976602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:12.976885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:12.977272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:12.977901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] RBAC: Adding query filter params (name=image) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:12.978206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:12.979592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:12.990230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 528/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:12.991489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.002755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.003287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.003568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.003844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.004575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:13.004877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.006302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.008646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.023708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 506/1034] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:13.029489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.095702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.097391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e54c6c-3434-484b-a38f-32f4882d8e03 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.131451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd14967-d522-41d8-a511-269bb9fe2ab9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.133671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.134284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.134562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.134827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.135453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] RBAC: Adding query filter params (type=image) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:13.135781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.137287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.141973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 529/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:13.142799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.167906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.168514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.168792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.169058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.216678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.237319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.238787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.239604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06def2-0f2a-43bc-a8c9-f1fedeacf452 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.273810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.274364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.274659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.274935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.276078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.277783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.279600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 530/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:13.280167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.312931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.349254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 507/1037] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 05:17:13.350069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.379455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209b51-d19a-460d-9f8c-0ab59d339b35 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.413041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.413646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.413914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.414182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.414872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] RBAC: Adding query filter params (interface=public, service_id=53a5940c31eb4a9c9f05306d33875b6c, region_id=RegionOne) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:13.415175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.416543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.422637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 531/1038] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/endpoints?service_id=53a5940c31eb4a9c9f05306d33875b6c&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:13.423441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.434321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.453095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622bec0-4710-43c5-a0ad-7fbb3989a3ec None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.487503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.488149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.488435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.488709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.489358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.490798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.516265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 508/1039] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:17:13 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:17:13.517091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.527190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812e0de-adda-4ad1-a09f-f97fce0b7572 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.544965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.570684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.571342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.571689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.571964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.584850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.586323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:13.602223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:13.603326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:13.605040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:13.605040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:13.605040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:13.605040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 532/1040] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:13.609605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.646266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d4d32-45ed-4249-8cb4-5826499fc9ac None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.672185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.687970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.688596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.688896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.689146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.689758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.691149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.698646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 509/1041] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/services => generated 1957 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:17:13.728793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e29dc-810e-4da7-859d-cd16fc8ad833 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.767471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.768134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.768419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.768692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.769347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:13.769645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.771035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.785340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 533/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:13.791290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:13.896954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:13.911755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a558c3e-137b-4602-83c2-7e15ef927036 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:13.947024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:13.947694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:13.947969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:13.948239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:13.955406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:13.956896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:17:13.968557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:13.969510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:13.970430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 510/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:13.975970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:14.078461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c1a4-52ad-4aa0-86d0-b0e99a1c5f2a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:14.100188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:14.116624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120ef55-33ba-4216-9a5c-c37b5c72d0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:14.117237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ef55-33ba-4216-9a5c-c37b5c72d0ed None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:14.117514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ef55-33ba-4216-9a5c-c37b5c72d0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:14.117848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120ef55-33ba-4216-9a5c-c37b5c72d0ed None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:14.118550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120ef55-33ba-4216-9a5c-c37b5c72d0ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:14.118884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120ef55-33ba-4216-9a5c-c37b5c72d0ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:14.120373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120ef55-33ba-4216-9a5c-c37b5c72d0ed None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:14.132210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 534/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:14.138556 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:14.245128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775d3e6-b1d3-4765-b353-8c2cbc183ef3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:14.282977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c4195-ac6e-4434-9318-55876e95e8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:14.282977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c4195-ac6e-4434-9318-55876e95e8bd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:14.282977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c4195-ac6e-4434-9318-55876e95e8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:14.282977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c4195-ac6e-4434-9318-55876e95e8bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:14.283424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c4195-ac6e-4434-9318-55876e95e8bd None admin] RBAC: Adding query filter params (role.id=b9183d1fb23548d3b90a5b072fc9b91e, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=291c79a765764420a4b836c478c385b6) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:14.283424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c4195-ac6e-4434-9318-55876e95e8bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:14.285512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c4195-ac6e-4434-9318-55876e95e8bd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:14.290696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 511/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:14 2022] GET /identity/v3/role_assignments?user.id=291c79a765764420a4b836c478c385b6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=b9183d1fb23548d3b90a5b072fc9b91e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:15.789950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bdf96-153c-473b-98af-230accab0838 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:15.790887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bdf96-153c-473b-98af-230accab0838 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:15.791176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991bdf96-153c-473b-98af-230accab0838 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:15.792915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 535/1046] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:15.798337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e359a-6d3f-4c62-a644-59191316d86d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:15.798749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e359a-6d3f-4c62-a644-59191316d86d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:15.798921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e359a-6d3f-4c62-a644-59191316d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:15.818321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-bd0e359a-6d3f-4c62-a644-59191316d86d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:15.819531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bd0e359a-6d3f-4c62-a644-59191316d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:15.827506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:15.852540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ee3d-d170-416b-9a90-8e82b6a6974f None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:15.852797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ee3d-d170-416b-9a90-8e82b6a6974f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:15.853100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72ee3d-d170-416b-9a90-8e82b6a6974f None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:15.854415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 536/1047] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:15.860124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6aa75-b4cc-4637-a556-4cb24238eaa6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:15.860417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6aa75-b4cc-4637-a556-4cb24238eaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:15.860669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6aa75-b4cc-4637-a556-4cb24238eaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:15.880385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7bb6aa75-b4cc-4637-a556-4cb24238eaa6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:15.881065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7bb6aa75-b4cc-4637-a556-4cb24238eaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:15.921674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 512/1048] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:15.959428 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 537/1049] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:17:16.218678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e359a-6d3f-4c62-a644-59191316d86d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.236992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6aa75-b4cc-4637-a556-4cb24238eaa6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.346203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e359a-6d3f-4c62-a644-59191316d86d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:16.383905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6aa75-b4cc-4637-a556-4cb24238eaa6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:16.389484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:16.390235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.390574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.390945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.397785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:16.406039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:16.410957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:16.412146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:16.413210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:16.414021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 513/1050] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:16.420376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.425229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:16.433149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:16.433808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.434097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.434368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] PATH_INFO: `/v3/services/image` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.434932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:16.436317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:16.446371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:16.447424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:16.448297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 538/1051] 10.222.0.18 () {56 vars in 1105 bytes} [Mon Sep 26 05:17:16 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:16.453989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.553228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047bcdd1-5f38-463f-b1b6-b3665bc969f9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:16.575501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b385bd-56b4-409a-859c-615cf9657882 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:16.595473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6a724-500b-4b97-be39-9a59eedde9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:16.596178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6a724-500b-4b97-be39-9a59eedde9ef None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.596453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6a724-500b-4b97-be39-9a59eedde9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.596712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6a724-500b-4b97-be39-9a59eedde9ef None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.597405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6a724-500b-4b97-be39-9a59eedde9ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:16.597719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6a724-500b-4b97-be39-9a59eedde9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:16.599089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6a724-500b-4b97-be39-9a59eedde9ef None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:16.608661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 514/1052] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:17:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:16.609907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e6a5-f220-4e74-85e5-ed245e5dbfed None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.610182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e6a5-f220-4e74-85e5-ed245e5dbfed None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.610456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e6a5-f220-4e74-85e5-ed245e5dbfed None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.615767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 515/1053] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:16.615906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23742f-7581-4711-9252-c5c0d7d6d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:16.616033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e6a5-f220-4e74-85e5-ed245e5dbfed None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.616129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23742f-7581-4711-9252-c5c0d7d6d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.616129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23742f-7581-4711-9252-c5c0d7d6d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.616129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23742f-7581-4711-9252-c5c0d7d6d0b0 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.616129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23742f-7581-4711-9252-c5c0d7d6d0b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:16.616436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23742f-7581-4711-9252-c5c0d7d6d0b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:16.617559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23742f-7581-4711-9252-c5c0d7d6d0b0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:16.625180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 539/1054] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:16.627596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdd977-0b89-4aef-af9f-9188e4b22c7e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.627888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdd977-0b89-4aef-af9f-9188e4b22c7e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.628171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdd977-0b89-4aef-af9f-9188e4b22c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.653324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a2bdd977-0b89-4aef-af9f-9188e4b22c7e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:16.654556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a2bdd977-0b89-4aef-af9f-9188e4b22c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:16.681578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:16.695764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:16.726237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e6a5-f220-4e74-85e5-ed245e5dbfed None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:16.740981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 540/1055] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:16.742183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdd977-0b89-4aef-af9f-9188e4b22c7e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.771653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:16.772506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.772770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.773043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] PATH_INFO: `/v3/users/097002f9f2824a43bda5af8e495e761b` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.789051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] RBAC: Authorizing `identity:get_user(user_id=097002f9f2824a43bda5af8e495e761b)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:16.790513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:16.792749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 516/1056] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:16 2022] GET /identity/v3/users/097002f9f2824a43bda5af8e495e761b => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:16.798545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.860801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdd977-0b89-4aef-af9f-9188e4b22c7e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:16.896258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:16.896930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.897204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.897470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:16.898095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] RBAC: Adding query filter params (type=image) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:16.898392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:16.899786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:16.910359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 541/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:16.911181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:16.912954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b9c01-9558-4b14-934d-3db5ea773776 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:16.937911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:16.947017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:16.953491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:16.954118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:16.954391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:16.954658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.019298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3d2a8-019e-4f0e-b883-d6bf2991fa6f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.025308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.026846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.052838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.053446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.053719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.053988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.054654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.056055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.077569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 542/1058] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:17:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:17:17.078987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:17.137657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 517/1059] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:17.138907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:17.165211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:17.181574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:17.207042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff709db7-c4e5-47bd-b82e-a90b11a35d4d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.246576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.247226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.247507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.247808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.252525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6d539-936a-4b81-8b80-46bb828b14e6 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.264327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:17.269137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:17.270059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:17.270924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 543/1060] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:17.277484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:17.298749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.298749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.298749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.298749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.300265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] RBAC: Authorizing `identity:get_project(project_id=42d54c3dd7d7493287aea32bb92a5b75)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.301929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.303719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 518/1061] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:17.309852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:17.394863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62133e29-2629-4fa0-8ea9-74124700f932 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.409571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:17.421273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfed0a-d877-41b2-9a8f-343ad9b2311a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.433662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.434278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.434553 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.434819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.435623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:17.435926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.437289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.458567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 544/1062] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:17.459658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:17.469523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:17.470504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.471411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.471522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.471735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.472482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=42d54c3dd7d7493287aea32bb92a5b75, user.id=097002f9f2824a43bda5af8e495e761b) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:17.472853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.474293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.480089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 519/1063] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/role_assignments?user.id=097002f9f2824a43bda5af8e495e761b&scope.project.id=42d54c3dd7d7493287aea32bb92a5b75&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:17.575281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343fa34-bc38-4e1d-9892-f21cbb16780b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.615597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.616267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.616545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.616816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.629122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.630630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:17.646236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:17.647235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:17.652748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:17.652748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:17.652748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:17.652748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 545/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:17.655316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:17.763534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91279af1-0149-4757-9a10-8ec10d3f7185 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.798395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.799066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.799631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.799631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.800261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:17.800564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.801942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.819207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 520/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:17.820485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:17.881716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:17.926114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e268-daa9-4b21-adc6-f02e61df7a8a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:17.961569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:17.962205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:17.962481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:17.962744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:17.971811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:17.973246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:17:17.985035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:17.986095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:17.992442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 546/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:17.993205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:18.013293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:18.105754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b82757-d8f6-43e3-98cb-97088cd7353e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:18.141503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:18.142114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:18.142387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:18.142655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:18.143375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:18.143710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:18.145147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:18.163513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 521/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:17:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:18.170008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:18.279904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba46c50-096c-4fd3-960e-b97a8eb8586a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:18.302903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:18.322944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:18.323838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:18.324454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:18.324726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:18.336163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:18.337628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:18.354415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:18.355793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:18.356728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:18.356728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:18.356728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:18.359686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 547/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:18.362580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:18.437149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:18.470222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea3a2a-30fc-431d-9947-28688c6a2c39 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:18.505233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:18.505836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:18.506111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:18.506376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:18.507014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:18.507313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:18.508730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:18.520751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 522/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:18.526381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:18.631527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962dbb-e0d2-4830-bc0c-db991d4576c3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:18.666522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:18.667204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:18.668072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:18.668353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:18.675682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:18.677129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:17:18.690474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:18.691413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:18.692652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:18.695856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 548/1070] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:18.697534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:18.802934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b89c0f-e510-44a7-a33b-f35aac397ca4 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:18.833721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:18.840617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99884898-7f9c-4b6e-a4e1-9e4fb0d0bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:18.841228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884898-7f9c-4b6e-a4e1-9e4fb0d0bc6f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:18.841504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884898-7f9c-4b6e-a4e1-9e4fb0d0bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:18.841772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99884898-7f9c-4b6e-a4e1-9e4fb0d0bc6f None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:18.842457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99884898-7f9c-4b6e-a4e1-9e4fb0d0bc6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:18.842759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99884898-7f9c-4b6e-a4e1-9e4fb0d0bc6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:18.844236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99884898-7f9c-4b6e-a4e1-9e4fb0d0bc6f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:18.856787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 523/1071] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:18.862658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:18.896022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:18.967889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e8b94-0882-4f82-b559-57c01ad9f1ba None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:19.001434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4ba28-168c-496f-94f4-e0da86d36ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:19.002102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4ba28-168c-496f-94f4-e0da86d36ad0 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:19.002381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4ba28-168c-496f-94f4-e0da86d36ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:19.002649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4ba28-168c-496f-94f4-e0da86d36ad0 None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/291c79a765764420a4b836c478c385b6/roles/b9183d1fb23548d3b90a5b072fc9b91e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:19.004795 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4ba28-168c-496f-94f4-e0da86d36ad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=291c79a765764420a4b836c478c385b6, role_id=b9183d1fb23548d3b90a5b072fc9b91e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:19.006225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4ba28-168c-496f-94f4-e0da86d36ad0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:19.021550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 549/1072] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:17:18 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/291c79a765764420a4b836c478c385b6/roles/b9183d1fb23548d3b90a5b072fc9b91e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:17:19.266810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ddb8-08a2-4b83-85f2-ea3305a79b6c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:19.266988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ddb8-08a2-4b83-85f2-ea3305a79b6c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:19.267295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0ddb8-08a2-4b83-85f2-ea3305a79b6c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:19.268833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 524/1073] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:19.274166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf1d8e-fb97-44c4-be41-2e83a100f60e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:19.274454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf1d8e-fb97-44c4-be41-2e83a100f60e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:19.274723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf1d8e-fb97-44c4-be41-2e83a100f60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:19.294527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-86bf1d8e-fb97-44c4-be41-2e83a100f60e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:19.297737 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-86bf1d8e-fb97-44c4-be41-2e83a100f60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:19.371636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 550/1074] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:19.635332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0ddb8-08a2-4b83-85f2-ea3305a79b6c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:19.657067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da906135-20cf-4099-b6ac-d83470c3f4b4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:19.657385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da906135-20cf-4099-b6ac-d83470c3f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:19.657628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da906135-20cf-4099-b6ac-d83470c3f4b4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:19.659110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 551/1075] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:17:19.663832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce0766-31ae-48fc-a154-466c337561fa None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:19.664116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce0766-31ae-48fc-a154-466c337561fa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:19.664424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce0766-31ae-48fc-a154-466c337561fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:19.684220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-93ce0766-31ae-48fc-a154-466c337561fa None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:19.685442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-93ce0766-31ae-48fc-a154-466c337561fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:19.702490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:19.750434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0ddb8-08a2-4b83-85f2-ea3305a79b6c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:19.764207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 552/1076] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:17:19.793418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:19.794064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:19.794304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:19.794608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:19.856987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:19.867070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:19.868596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:19.972728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 525/1077] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:19.978624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce0766-31ae-48fc-a154-466c337561fa None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:20.041097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:20.082295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce0766-31ae-48fc-a154-466c337561fa None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:20.124254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:20.124898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:20.125175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:20.125445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:20.136857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:20.138640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:20.144047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:20.155017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11da276-96a4-4cb1-8e9f-d776854a4143 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:20.155201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:20.156147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:20.162466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:20.162466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:20.162466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:20.162466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 553/1078] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:20.164875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:20.168043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:20.199702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:20.200464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:20.200746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:20.201017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:20.212828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:20.218300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:20.219301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:20.220184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:20.224729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 526/1079] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:20.225338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:20.272987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d95af-4343-4be8-9035-8615ba7ae7fa None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:20.311613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:20.312225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:20.312845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:20.313112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:20.313749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:20.314046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:20.315407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:20.327978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 554/1080] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:20.341995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32245ed3-4dfd-4990-8fac-84a1f94dbd41 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:20.387897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:20.388539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:20.388820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:20.389089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:20.389782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:20.390086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:20.391510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:20.402651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 527/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:20.408463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:20.482490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:20.525747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f80b-3a4e-412b-9944-96a424fd964f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:20.561947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:20.563249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:20.563535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:20.563886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] PATH_INFO: `/v3/users/097002f9f2824a43bda5af8e495e761b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:20.565443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] RBAC: Authorizing `identity:get_user(user_id=097002f9f2824a43bda5af8e495e761b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:20.566874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:20.568874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 555/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:20 2022] GET /identity/v3/users/097002f9f2824a43bda5af8e495e761b => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:20.574966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:20.592721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:20.680406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbc183-7ab9-4a30-9563-77f54121e7e2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:20.714609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68199ef7-2497-4a59-a891-889fef314352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:20.715239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199ef7-2497-4a59-a891-889fef314352 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:20.715522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199ef7-2497-4a59-a891-889fef314352 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:20.715822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68199ef7-2497-4a59-a891-889fef314352 None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:20.716991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68199ef7-2497-4a59-a891-889fef314352 None admin] RBAC: Authorizing `identity:get_project(project_id=42d54c3dd7d7493287aea32bb92a5b75)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:20.718447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68199ef7-2497-4a59-a891-889fef314352 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:20.720120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 528/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:20 2022] GET /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:20.726206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:20.828300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584bdaa-0920-443f-9209-d428bb03cde8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:20.863026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:20.869951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69cde-bc92-44b0-a4ac-af9450a0706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:20.870853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69cde-bc92-44b0-a4ac-af9450a0706c None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:20.871135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69cde-bc92-44b0-a4ac-af9450a0706c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:20.871507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69cde-bc92-44b0-a4ac-af9450a0706c None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75/users/097002f9f2824a43bda5af8e495e761b/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:20.873507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69cde-bc92-44b0-a4ac-af9450a0706c None admin] RBAC: Authorizing `identity:create_grant(project_id=42d54c3dd7d7493287aea32bb92a5b75, user_id=097002f9f2824a43bda5af8e495e761b, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:20.874940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba69cde-bc92-44b0-a4ac-af9450a0706c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:20.888898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 556/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:17:20 2022] PUT /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75/users/097002f9f2824a43bda5af8e495e761b/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:17:21.175569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf965ba-8e1b-4a72-8f29-ee827f13d4e7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:21.176134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf965ba-8e1b-4a72-8f29-ee827f13d4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:21.176134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf965ba-8e1b-4a72-8f29-ee827f13d4e7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:21.177419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 529/1085] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:21.183013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32deede-5921-459b-a133-8fee496b3aa9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:21.183521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32deede-5921-459b-a133-8fee496b3aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:21.183521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32deede-5921-459b-a133-8fee496b3aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:21.203442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b32deede-5921-459b-a133-8fee496b3aa9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:21.204696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b32deede-5921-459b-a133-8fee496b3aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:21.274183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 557/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:21.540541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf965ba-8e1b-4a72-8f29-ee827f13d4e7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:21.630921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:21.652828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf965ba-8e1b-4a72-8f29-ee827f13d4e7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:21.688148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:21.688775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:21.689053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:21.689316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:21.700822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:21.705547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:21.707697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:21.708600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 530/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Mon Sep 26 05:17:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:21.712884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32deede-5921-459b-a133-8fee496b3aa9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:21.819020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32deede-5921-459b-a133-8fee496b3aa9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:21.839227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:21.855913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:21.856520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:21.856798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:21.857069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:21.857733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:21.858036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:21.859398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:21.867489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 558/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 05:17:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:21.874730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:21.979216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2339568-7bef-403f-945a-7963af1db213 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:22.014953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:22.015574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:22.015886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:22.016156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:22.027237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:22.028723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:22.030440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:22.044572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:22.045598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:22.046540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:22.046540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:22.046540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:22.046540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 531/1089] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:22.051640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:22.157342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17eb6c-48ea-4803-90c1-248965d0c6ee None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:22.190647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:22.191255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:22.191497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:22.191790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:22.192409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:22.192708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:22.194080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:22.205700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 559/1090] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:22.211646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:22.321585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad782ad8-4000-4527-824e-e8c7eefe0937 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:22.357788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:22.358414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:22.358687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:22.358951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:22.366600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:22.368078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:17:22.379314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:22.380382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:22.381878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 532/1091] 10.222.0.18 () {56 vars in 1093 bytes} [Mon Sep 26 05:17:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:22.386481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:22.430568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:22.486986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17c6c4-2447-448d-a570-794c4378d51b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:22.522098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:22.522709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:22.522993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:22.523259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:22.524018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:22.524303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:22.525746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:22.543052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 560/1092] 10.222.0.18 () {56 vars in 1133 bytes} [Mon Sep 26 05:17:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:22.549057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:22.607953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:22.654990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2466e64-58aa-462c-a473-33fbc7eb27c1 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:22.700160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566cf5e-6a6a-4d9b-b244-c0d6e6d93489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:22.700686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566cf5e-6a6a-4d9b-b244-c0d6e6d93489 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:22.700967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566cf5e-6a6a-4d9b-b244-c0d6e6d93489 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:22.701239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566cf5e-6a6a-4d9b-b244-c0d6e6d93489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:22.770895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566cf5e-6a6a-4d9b-b244-c0d6e6d93489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:22.772382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566cf5e-6a6a-4d9b-b244-c0d6e6d93489 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:22.827563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:22.875975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 533/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:22.881954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:22.985416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:22.988485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5575e-8b31-4f0d-80c6-7bc552932932 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.022825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.023458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.023769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.024042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.033001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94efa-7323-4008-b2c8-c65e3ac8fc35 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.033304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94efa-7323-4008-b2c8-c65e3ac8fc35 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.033544 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d94efa-7323-4008-b2c8-c65e3ac8fc35 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.034909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 534/1094] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:17:23.035668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:23.037145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:23.040887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87d29-49ac-4f5d-8668-e6247e08489b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.041278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87d29-49ac-4f5d-8668-e6247e08489b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.041680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87d29-49ac-4f5d-8668-e6247e08489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:23.058311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:23.059490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:17:23.060528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:23.060528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:17:23.060528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:23.060528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 561/1095] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:23.065304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-51d87d29-49ac-4f5d-8668-e6247e08489b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:23.065715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.066507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-51d87d29-49ac-4f5d-8668-e6247e08489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:23.139093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 535/1096] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:23.169416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a65fad-78ae-4327-983e-d71bc0b00fd2 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.204429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.205062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.205302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.205565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.206205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:23.206504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:23.207900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:23.220658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 562/1097] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:23.226522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87d29-49ac-4f5d-8668-e6247e08489b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.318985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:23.335899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87d29-49ac-4f5d-8668-e6247e08489b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.371270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.371940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.372216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.372489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.379711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:23.381189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:17:23.393458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:23.394396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:23.395403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 536/1098] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:23.401069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.406012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.418847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:23.505505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75526cdb-2086-40b1-97f3-63347ed7bc4a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.505709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93111d-7ccb-4106-b0e0-346b321d4a4e None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.539186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.539749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.539930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.540040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.540276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.540566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.540843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.541044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:23.541133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.541346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:23.542849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:23.553174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:23.554480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 563/1099] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:23.557998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:23.559154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:23.560570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 537/1100] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:17:23.562732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.566016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.570335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:23.635850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:23.666756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ebf07-1fd2-4bf6-9c19-d126f4928e5c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.666965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94684e-9c31-4cec-a2b7-72dceb6f0d94 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.700785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.701400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.701682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.701852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.701966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.702463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.702667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] RBAC: Adding query filter params (role.id=b9183d1fb23548d3b90a5b072fc9b91e, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=291c79a765764420a4b836c478c385b6) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:23.702768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.702976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:23.703072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.703673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:23.703978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:23.704444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:23.705451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:23.710234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 564/1101] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/role_assignments?user.id=291c79a765764420a4b836c478c385b6&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=b9183d1fb23548d3b90a5b072fc9b91e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:23.715423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 538/1102] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:23.721604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.831477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01869e7-a020-4e62-bec9-9f7b2504866d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:23.868657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:23.869312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:23.869593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:23.869866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] PATH_INFO: `/v3/users/097002f9f2824a43bda5af8e495e761b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:23.871371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] RBAC: Authorizing `identity:get_user(user_id=097002f9f2824a43bda5af8e495e761b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:23.872863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:23.874719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 565/1103] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/users/097002f9f2824a43bda5af8e495e761b => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:23.880760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:23.954187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:23.993645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c2baf4-b018-4730-b053-2757f1ffc435 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:24.035152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:24.035853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:24.036912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:24.037050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:24.120089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:24.121899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:24.195277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:24.234954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 539/1104] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:24.240584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:24.248206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:24.353470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc137aee-6c38-4adb-a154-8db3bdc48a10 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:24.386916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad117f2-3928-4164-bacc-5b4ac27fa6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:24.387469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad117f2-3928-4164-bacc-5b4ac27fa6dc None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:24.387779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad117f2-3928-4164-bacc-5b4ac27fa6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:24.388050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad117f2-3928-4164-bacc-5b4ac27fa6dc None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:24.389204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad117f2-3928-4164-bacc-5b4ac27fa6dc None admin] RBAC: Authorizing `identity:get_project(project_id=42d54c3dd7d7493287aea32bb92a5b75)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:24.390677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad117f2-3928-4164-bacc-5b4ac27fa6dc None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:24.392596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 566/1105] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:24 2022] GET /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:24.398692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:24.510487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae59c5b-0d52-426f-ba86-df3cbad2f43e None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:24.545377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76b951-38fa-43eb-9ae3-c011a16a5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:24.546005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b951-38fa-43eb-9ae3-c011a16a5b56 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:24.546279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b951-38fa-43eb-9ae3-c011a16a5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:24.546552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b951-38fa-43eb-9ae3-c011a16a5b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:24.547273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76b951-38fa-43eb-9ae3-c011a16a5b56 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=42d54c3dd7d7493287aea32bb92a5b75, user.id=097002f9f2824a43bda5af8e495e761b) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:24.547596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76b951-38fa-43eb-9ae3-c011a16a5b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:24.549047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76b951-38fa-43eb-9ae3-c011a16a5b56 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:24.554924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 540/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:24 2022] GET /identity/v3/role_assignments?user.id=097002f9f2824a43bda5af8e495e761b&scope.project.id=42d54c3dd7d7493287aea32bb92a5b75&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:26.724004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe93f-acdf-4c97-8bea-bbdb32395c8c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:26.724625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe93f-acdf-4c97-8bea-bbdb32395c8c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:26.724625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbe93f-acdf-4c97-8bea-bbdb32395c8c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:26.725889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 567/1107] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:26.732594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef57b3-efbf-4b1b-abf1-2fedcf653de7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:26.733400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef57b3-efbf-4b1b-abf1-2fedcf653de7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:26.733400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef57b3-efbf-4b1b-abf1-2fedcf653de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:26.756837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-81ef57b3-efbf-4b1b-abf1-2fedcf653de7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:26.758031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-81ef57b3-efbf-4b1b-abf1-2fedcf653de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:26.782576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:26.827196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 541/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:27.097158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbe93f-acdf-4c97-8bea-bbdb32395c8c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:27.190600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:27.226185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbe93f-acdf-4c97-8bea-bbdb32395c8c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:27.263343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad03c86-4630-42ed-8d39-afe6a146104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:27.263999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad03c86-4630-42ed-8d39-afe6a146104a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:27.264271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad03c86-4630-42ed-8d39-afe6a146104a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:27.264536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad03c86-4630-42ed-8d39-afe6a146104a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:27.265669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad03c86-4630-42ed-8d39-afe6a146104a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:27.267094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad03c86-4630-42ed-8d39-afe6a146104a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:27.268781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 568/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:27.274678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef57b3-efbf-4b1b-abf1-2fedcf653de7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:27.377881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef57b3-efbf-4b1b-abf1-2fedcf653de7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:27.413848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce552e-fda6-4390-9335-252c83a9f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:27.414445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce552e-fda6-4390-9335-252c83a9f2fe None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:27.414716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce552e-fda6-4390-9335-252c83a9f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:27.414978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce552e-fda6-4390-9335-252c83a9f2fe None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:27.415654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce552e-fda6-4390-9335-252c83a9f2fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:27.417116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce552e-fda6-4390-9335-252c83a9f2fe None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:27.441401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 542/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:17:27 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:17:29.656591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1642-013c-4163-9d1f-7f616337b72b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:29.657147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1642-013c-4163-9d1f-7f616337b72b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:29.657147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1642-013c-4163-9d1f-7f616337b72b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:29.658499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 569/1111] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:29.664942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7e25-7cac-403d-bd31-2543347c5d6f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:29.665655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7e25-7cac-403d-bd31-2543347c5d6f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:29.665819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f7e25-7cac-403d-bd31-2543347c5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:29.692466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e57f7e25-7cac-403d-bd31-2543347c5d6f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:29.693670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e57f7e25-7cac-403d-bd31-2543347c5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:29.706169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:29.770053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 543/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:30.035647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1642-013c-4163-9d1f-7f616337b72b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:30.144570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1642-013c-4163-9d1f-7f616337b72b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:30.180695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:30.181760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:30.182258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:30.182753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] PATH_INFO: `/v3/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:30.185364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] RBAC: Authorizing `identity:get_role(role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:30.187071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:30.188808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 570/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:30 2022] GET /identity/v3/roles/849d3aaa045348b78fb1017e4080b01c => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:30.195282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7e25-7cac-403d-bd31-2543347c5d6f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:30.315105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f7e25-7cac-403d-bd31-2543347c5d6f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:30.352102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:30.352730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:30.353008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:30.353277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] PATH_INFO: `/v3/users/1b6d87a1447142c8b1c81a30433fe189` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:30.366816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] RBAC: Authorizing `identity:get_user(user_id=1b6d87a1447142c8b1c81a30433fe189)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:30.368307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:30.369872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 544/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:30 2022] GET /identity/v3/users/1b6d87a1447142c8b1c81a30433fe189 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:30.376235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:30.388463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:30.493451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6742aa5-03c1-4462-838f-dbd343995ab3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:30.530177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:30.530778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:30.531064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:30.531323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:30.608517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:30.609972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:30.619536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:30.723109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 571/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:30.729425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:30.734187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:30.841799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253ffb6-ac8d-4ba6-b656-2d9ebcf42570 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:30.879422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062547a-2d5b-4290-96ab-66381d1440f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:30.880004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062547a-2d5b-4290-96ab-66381d1440f0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:30.880282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062547a-2d5b-4290-96ab-66381d1440f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:30.880550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062547a-2d5b-4290-96ab-66381d1440f0 None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:30.881800 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062547a-2d5b-4290-96ab-66381d1440f0 None admin] RBAC: Authorizing `identity:get_project(project_id=42d54c3dd7d7493287aea32bb92a5b75)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:30.883246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062547a-2d5b-4290-96ab-66381d1440f0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:30.884907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 545/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:30 2022] GET /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:30.894136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:31.004602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906aad7-ccfe-46eb-9ecf-990527459899 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:31.014386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:31.041552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caee21-3e2e-48c4-995c-06f4c7d78fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:31.042150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caee21-3e2e-48c4-995c-06f4c7d78fee None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:31.042424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caee21-3e2e-48c4-995c-06f4c7d78fee None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:31.042698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caee21-3e2e-48c4-995c-06f4c7d78fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:31.043424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caee21-3e2e-48c4-995c-06f4c7d78fee None admin] RBAC: Adding query filter params (role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=42d54c3dd7d7493287aea32bb92a5b75, user.id=1b6d87a1447142c8b1c81a30433fe189) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:31.043819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caee21-3e2e-48c4-995c-06f4c7d78fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:31.045369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caee21-3e2e-48c4-995c-06f4c7d78fee None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:31.050904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 572/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:30 2022] GET /identity/v3/role_assignments?user.id=1b6d87a1447142c8b1c81a30433fe189&scope.project.id=42d54c3dd7d7493287aea32bb92a5b75&role.id=849d3aaa045348b78fb1017e4080b01c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:33.135766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df9573-9c14-4cba-b1dc-d1464cf16032 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:33.136365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df9573-9c14-4cba-b1dc-d1464cf16032 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:33.136365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df9573-9c14-4cba-b1dc-d1464cf16032 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:33.137816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 546/1118] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:33.144205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be666-ae5b-485b-90f4-47efc174d161 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:33.144976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be666-ae5b-485b-90f4-47efc174d161 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:33.145122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945be666-ae5b-485b-90f4-47efc174d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:33.172995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-945be666-ae5b-485b-90f4-47efc174d161 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:33.174169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-945be666-ae5b-485b-90f4-47efc174d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:33.256144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 573/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:33.519799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df9573-9c14-4cba-b1dc-d1464cf16032 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:33.601330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:33.634113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df9573-9c14-4cba-b1dc-d1464cf16032 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:33.671320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:33.672058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:33.672342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:33.672611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] PATH_INFO: `/v3/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:33.674057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] RBAC: Authorizing `identity:get_role(role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:33.675448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:33.676814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 547/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:33 2022] GET /identity/v3/roles/849d3aaa045348b78fb1017e4080b01c => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:33.686325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945be666-ae5b-485b-90f4-47efc174d161 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:33.792825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945be666-ae5b-485b-90f4-47efc174d161 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:33.794388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:33.831318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041750b-e24f-455c-9523-a3228125899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:33.831980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041750b-e24f-455c-9523-a3228125899a None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:33.832264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041750b-e24f-455c-9523-a3228125899a None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:33.832531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041750b-e24f-455c-9523-a3228125899a None admin] PATH_INFO: `/v3/users/1b6d87a1447142c8b1c81a30433fe189` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:33.833725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041750b-e24f-455c-9523-a3228125899a None admin] RBAC: Authorizing `identity:get_user(user_id=1b6d87a1447142c8b1c81a30433fe189)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:33.835158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0041750b-e24f-455c-9523-a3228125899a None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:33.836792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 574/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:33 2022] GET /identity/v3/users/1b6d87a1447142c8b1c81a30433fe189 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:33.843960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:33.967837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c520c-2ee7-4977-965d-cc03ebf2f248 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:34.006421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5661c-1dc6-4bba-99ab-55ad2bf82f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:34.007039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5661c-1dc6-4bba-99ab-55ad2bf82f9f None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:34.007317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5661c-1dc6-4bba-99ab-55ad2bf82f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:34.007574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5661c-1dc6-4bba-99ab-55ad2bf82f9f None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:34.008853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5661c-1dc6-4bba-99ab-55ad2bf82f9f None admin] RBAC: Authorizing `identity:get_project(project_id=42d54c3dd7d7493287aea32bb92a5b75)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:34.010291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5661c-1dc6-4bba-99ab-55ad2bf82f9f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:34.011930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 548/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:33 2022] GET /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:34.018955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041750b-e24f-455c-9523-a3228125899a None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:34.133060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041750b-e24f-455c-9523-a3228125899a None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:34.170135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe3d8-452a-42dd-89f8-4cf547b70009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:34.170750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe3d8-452a-42dd-89f8-4cf547b70009 None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:34.171030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe3d8-452a-42dd-89f8-4cf547b70009 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:34.171298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe3d8-452a-42dd-89f8-4cf547b70009 None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75/users/1b6d87a1447142c8b1c81a30433fe189/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:34.173819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fe3d8-452a-42dd-89f8-4cf547b70009 None admin] RBAC: Authorizing `identity:create_grant(project_id=42d54c3dd7d7493287aea32bb92a5b75, user_id=1b6d87a1447142c8b1c81a30433fe189, role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:34.175233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fe3d8-452a-42dd-89f8-4cf547b70009 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:34.196569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 575/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:17:34 2022] PUT /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75/users/1b6d87a1447142c8b1c81a30433fe189/roles/849d3aaa045348b78fb1017e4080b01c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:17:36.307018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee354-5e73-4362-ac03-83dbaef039e8 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:36.307866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee354-5e73-4362-ac03-83dbaef039e8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:36.307991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ee354-5e73-4362-ac03-83dbaef039e8 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:36.310501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 549/1124] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:36.316194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5394-9b98-4f52-8e5b-59b67f636dd9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:36.316643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5394-9b98-4f52-8e5b-59b67f636dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:36.316744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5394-9b98-4f52-8e5b-59b67f636dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:36.336340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-360c5394-9b98-4f52-8e5b-59b67f636dd9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:36.337550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-360c5394-9b98-4f52-8e5b-59b67f636dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:36.363469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:36.413090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 576/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:36.684384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee354-5e73-4362-ac03-83dbaef039e8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:36.701377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:36.800846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ee354-5e73-4362-ac03-83dbaef039e8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:36.837591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:36.838203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:36.838482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:36.838748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] PATH_INFO: `/v3/roles/849d3aaa045348b78fb1017e4080b01c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:36.840234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] RBAC: Authorizing `identity:get_role(role_id=849d3aaa045348b78fb1017e4080b01c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:36.841697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:36.843045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 550/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:36 2022] GET /identity/v3/roles/849d3aaa045348b78fb1017e4080b01c => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:36.849781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5394-9b98-4f52-8e5b-59b67f636dd9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:36.955275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5394-9b98-4f52-8e5b-59b67f636dd9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:36.989812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:36.990435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:36.990715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:36.990989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] PATH_INFO: `/v3/users/1b6d87a1447142c8b1c81a30433fe189` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:36.992155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=1b6d87a1447142c8b1c81a30433fe189)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:36.993583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:36.995168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 577/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:36 2022] GET /identity/v3/users/1b6d87a1447142c8b1c81a30433fe189 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:37.002024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:37.085784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:37.112884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae59e0-7366-4cd5-b8a0-e41e93717834 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:37.158270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:37.158868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:37.159148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:37.159417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:37.229739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:37.231150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:37.314084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:37.348271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 551/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:37.354565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:37.384815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:37.460292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8679608a-6e31-424c-a800-b4699417d2c9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:37.492977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7d123-a875-40c6-8249-e0821c7a08ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:37.493530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7d123-a875-40c6-8249-e0821c7a08ed None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:37.493809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7d123-a875-40c6-8249-e0821c7a08ed None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:37.494082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7d123-a875-40c6-8249-e0821c7a08ed None admin] PATH_INFO: `/v3/projects/42d54c3dd7d7493287aea32bb92a5b75` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:37.495286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7d123-a875-40c6-8249-e0821c7a08ed None admin] RBAC: Authorizing `identity:get_project(project_id=42d54c3dd7d7493287aea32bb92a5b75)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:37.496746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7d123-a875-40c6-8249-e0821c7a08ed None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:37.498524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 578/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:37 2022] GET /identity/v3/projects/42d54c3dd7d7493287aea32bb92a5b75 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:37.508246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:37.613635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae40ba0-6bae-432a-ab08-8a38f94d3b83 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:37.648012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ec71f-859f-43fe-8712-d4196de6995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:37.648644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec71f-859f-43fe-8712-d4196de6995c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:37.648918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec71f-859f-43fe-8712-d4196de6995c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:37.649182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ec71f-859f-43fe-8712-d4196de6995c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:37.649896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ec71f-859f-43fe-8712-d4196de6995c None admin] RBAC: Adding query filter params (role.id=849d3aaa045348b78fb1017e4080b01c, scope.project.id=42d54c3dd7d7493287aea32bb92a5b75, user.id=1b6d87a1447142c8b1c81a30433fe189) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:37.650200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ec71f-859f-43fe-8712-d4196de6995c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:37.651653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ec71f-859f-43fe-8712-d4196de6995c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:37.659084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 552/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:37 2022] GET /identity/v3/role_assignments?user.id=1b6d87a1447142c8b1c81a30433fe189&scope.project.id=42d54c3dd7d7493287aea32bb92a5b75&role.id=849d3aaa045348b78fb1017e4080b01c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:39.921388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7144-dde5-4592-bdeb-7a7ecd5027be None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:39.922267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7144-dde5-4592-bdeb-7a7ecd5027be None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:39.922267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a7144-dde5-4592-bdeb-7a7ecd5027be None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:39.924499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 579/1131] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:39.933515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2326-00a4-475c-b249-bfb7a8e6abd3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:39.934158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2326-00a4-475c-b249-bfb7a8e6abd3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:39.934158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee2326-00a4-475c-b249-bfb7a8e6abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:39.958646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-39ee2326-00a4-475c-b249-bfb7a8e6abd3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:39.959880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-39ee2326-00a4-475c-b249-bfb7a8e6abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:39.997291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:40.031059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 553/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:40.305633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a7144-dde5-4592-bdeb-7a7ecd5027be None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:40.409518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:40.421080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a7144-dde5-4592-bdeb-7a7ecd5027be None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:40.462156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80e8ea-92f6-4137-b045-74df54cf0540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:40.462777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e8ea-92f6-4137-b045-74df54cf0540 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:40.463050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e8ea-92f6-4137-b045-74df54cf0540 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:40.463320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e8ea-92f6-4137-b045-74df54cf0540 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:40.464611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80e8ea-92f6-4137-b045-74df54cf0540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:40.466518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80e8ea-92f6-4137-b045-74df54cf0540 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:40.468115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 580/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:40.475103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2326-00a4-475c-b249-bfb7a8e6abd3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:40.591009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee2326-00a4-475c-b249-bfb7a8e6abd3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:40.626171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0a05d-e95b-4b25-87ad-8a331daf836f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:40.626766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0a05d-e95b-4b25-87ad-8a331daf836f None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:40.627040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0a05d-e95b-4b25-87ad-8a331daf836f None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:40.627310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0a05d-e95b-4b25-87ad-8a331daf836f None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:40.627987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0a05d-e95b-4b25-87ad-8a331daf836f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:40.629429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0a05d-e95b-4b25-87ad-8a331daf836f None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:40.665259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 554/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:17:40 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:17:42.885843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355ac1-ac94-444c-b074-402dbb4ba078 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:42.886448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355ac1-ac94-444c-b074-402dbb4ba078 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:42.886448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355ac1-ac94-444c-b074-402dbb4ba078 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:42.888416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 581/1135] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:42.894851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d13b3-e9b3-4e63-be9b-61e827be9a5f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:42.895613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d13b3-e9b3-4e63-be9b-61e827be9a5f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:42.895755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d13b3-e9b3-4e63-be9b-61e827be9a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:42.923894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ce3d13b3-e9b3-4e63-be9b-61e827be9a5f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:42.925077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ce3d13b3-e9b3-4e63-be9b-61e827be9a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:42.943356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:42.998064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 555/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:43.259270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13355ac1-ac94-444c-b074-402dbb4ba078 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:43.371636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13355ac1-ac94-444c-b074-402dbb4ba078 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:43.407408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e81ab-b6fa-4e34-a593-1fe5318964a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:43.408059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e81ab-b6fa-4e34-a593-1fe5318964a9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:43.408334 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e81ab-b6fa-4e34-a593-1fe5318964a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:43.408606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e81ab-b6fa-4e34-a593-1fe5318964a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:43.409857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e81ab-b6fa-4e34-a593-1fe5318964a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:43.411278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e81ab-b6fa-4e34-a593-1fe5318964a9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:43.412893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 582/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:17:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:43.422229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d13b3-e9b3-4e63-be9b-61e827be9a5f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:43.527221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d13b3-e9b3-4e63-be9b-61e827be9a5f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:43.563158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d75de5-2544-4e9d-b5e3-3e852d16390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:43.563776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d75de5-2544-4e9d-b5e3-3e852d16390c None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:43.564046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d75de5-2544-4e9d-b5e3-3e852d16390c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:43.564309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d75de5-2544-4e9d-b5e3-3e852d16390c None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:43.564952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d75de5-2544-4e9d-b5e3-3e852d16390c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:43.566375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d75de5-2544-4e9d-b5e3-3e852d16390c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:43.593159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 556/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:17:43 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:17:45.736510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ed4af-cfe2-4115-862e-b4a9dc394c39 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:45.737116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ed4af-cfe2-4115-862e-b4a9dc394c39 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:45.737116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ed4af-cfe2-4115-862e-b4a9dc394c39 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:45.738383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 583/1139] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:45.744577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce216f-c958-4d64-81bf-0b4521bf920d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:45.745295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce216f-c958-4d64-81bf-0b4521bf920d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:45.745456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce216f-c958-4d64-81bf-0b4521bf920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:45.769288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a3ce216f-c958-4d64-81bf-0b4521bf920d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:45.770492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a3ce216f-c958-4d64-81bf-0b4521bf920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:45.772449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:45.850899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 557/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:46.118208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ed4af-cfe2-4115-862e-b4a9dc394c39 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:46.156066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:46.245736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ed4af-cfe2-4115-862e-b4a9dc394c39 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:46.282284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:46.282910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:46.283184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:46.283452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:46.294690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:46.299379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:46.300605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:46.301701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 584/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:17:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:46.307310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce216f-c958-4d64-81bf-0b4521bf920d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:46.412900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce216f-c958-4d64-81bf-0b4521bf920d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:46.454841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:46.455452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:46.455765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:46.456035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:46.456712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:46.457013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:46.458396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:46.463691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:46.467850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 558/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:17:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:46.474714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:46.577732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:46.587888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ddf3d-ef52-4999-9782-1ce56f0749d3 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:46.624802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:46.625427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:46.625702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:46.625969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] PATH_INFO: `/v3/users/318c28a58d7f44de8c470f8453aca6bd` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:46.641459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] RBAC: Authorizing `identity:get_user(user_id=318c28a58d7f44de8c470f8453aca6bd)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:46.642890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:46.644503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 585/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:46 2022] GET /identity/v3/users/318c28a58d7f44de8c470f8453aca6bd => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:46.650423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:46.778718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ac70e-3b10-48cf-b22b-e980ecdecf22 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:46.815746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:46.816348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:46.816627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:46.816899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:46.884150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:46.886560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:46.888252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:46.996517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 559/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 26 05:17:47.005932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:47.118385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863c74-3b69-41e7-8aaa-a861e60a5547 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:47.153985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ff27-d062-4be0-ab92-a80e0c3b3149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:47.154597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ff27-d062-4be0-ab92-a80e0c3b3149 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:47.154870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ff27-d062-4be0-ab92-a80e0c3b3149 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:47.155137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ff27-d062-4be0-ab92-a80e0c3b3149 None admin] PATH_INFO: `/v3/projects/2127e9629b274844ac910faf75b3f10a` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:47.156287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ff27-d062-4be0-ab92-a80e0c3b3149 None admin] RBAC: Authorizing `identity:get_project(project_id=2127e9629b274844ac910faf75b3f10a)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:47.157707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729ff27-d062-4be0-ab92-a80e0c3b3149 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:47.159311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 586/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:47 2022] GET /identity/v3/projects/2127e9629b274844ac910faf75b3f10a => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:47.165542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:47.271719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:47.276269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00727c-6a92-40c5-aab8-bcd0b7721b37 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:47.318912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a29d-d166-450d-b961-1c5cb4c82ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:47.319519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a29d-d166-450d-b961-1c5cb4c82ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:47.319828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a29d-d166-450d-b961-1c5cb4c82ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:47.320095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a29d-d166-450d-b961-1c5cb4c82ac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:47.320811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a29d-d166-450d-b961-1c5cb4c82ac9 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=2127e9629b274844ac910faf75b3f10a, user.id=318c28a58d7f44de8c470f8453aca6bd) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:47.321121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a29d-d166-450d-b961-1c5cb4c82ac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:47.322543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a29d-d166-450d-b961-1c5cb4c82ac9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:47.328421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 560/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:47 2022] GET /identity/v3/role_assignments?user.id=318c28a58d7f44de8c470f8453aca6bd&scope.project.id=2127e9629b274844ac910faf75b3f10a&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:49.442049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244c2c-341b-4fd4-b0a0-444a25234cac None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:49.442941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244c2c-341b-4fd4-b0a0-444a25234cac None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:49.442941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81244c2c-341b-4fd4-b0a0-444a25234cac None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:49.445108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 587/1147] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:49.455029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07cbd6-14dd-41bb-b01e-bb534c2dc405 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:49.455483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07cbd6-14dd-41bb-b01e-bb534c2dc405 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:49.455621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07cbd6-14dd-41bb-b01e-bb534c2dc405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:49.474785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2d07cbd6-14dd-41bb-b01e-bb534c2dc405 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:49.476020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2d07cbd6-14dd-41bb-b01e-bb534c2dc405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:49.553129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 561/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:49.825300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81244c2c-341b-4fd4-b0a0-444a25234cac None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:49.851679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:49.940496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81244c2c-341b-4fd4-b0a0-444a25234cac None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:49.976190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:49.976809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:49.977080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:49.977345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:49.987886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:49.992612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:49.993656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:49.994952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 588/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:17:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:50.002850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07cbd6-14dd-41bb-b01e-bb534c2dc405 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:50.104494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:50.111291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07cbd6-14dd-41bb-b01e-bb534c2dc405 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:50.150110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:50.150707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:50.150978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:50.151241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:50.151928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:50.152321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:50.153676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:50.161835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 562/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:17:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:50.168125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:50.251224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:50.278601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7596458-83c4-42c8-89da-6d40857b1e83 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:50.316600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:50.317214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:50.317483 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:50.317749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] PATH_INFO: `/v3/users/318c28a58d7f44de8c470f8453aca6bd` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:50.318969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] RBAC: Authorizing `identity:get_user(user_id=318c28a58d7f44de8c470f8453aca6bd)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:50.320430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:50.322002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 589/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:50 2022] GET /identity/v3/users/318c28a58d7f44de8c470f8453aca6bd => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:50.330148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:50.440886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff17b3f-2729-4dcc-9f65-8660c0bd87ae None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:50.475833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26d3e5-51d1-4dab-b09a-36009ee86914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:50.476467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d3e5-51d1-4dab-b09a-36009ee86914 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:50.476719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d3e5-51d1-4dab-b09a-36009ee86914 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:50.476984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26d3e5-51d1-4dab-b09a-36009ee86914 None admin] PATH_INFO: `/v3/projects/2127e9629b274844ac910faf75b3f10a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:50.478154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d3e5-51d1-4dab-b09a-36009ee86914 None admin] RBAC: Authorizing `identity:get_project(project_id=2127e9629b274844ac910faf75b3f10a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:50.479579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26d3e5-51d1-4dab-b09a-36009ee86914 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:50.481252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 563/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:50 2022] GET /identity/v3/projects/2127e9629b274844ac910faf75b3f10a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:50.490589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:50.611723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcff70f-0fa2-45a8-b577-6c74b8f177ac None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:50.646878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3601b-a66d-41a6-bfeb-a9242f81a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:50.647521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3601b-a66d-41a6-bfeb-a9242f81a55b None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:50.647831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3601b-a66d-41a6-bfeb-a9242f81a55b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:50.648102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3601b-a66d-41a6-bfeb-a9242f81a55b None admin] PATH_INFO: `/v3/projects/2127e9629b274844ac910faf75b3f10a/users/318c28a58d7f44de8c470f8453aca6bd/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:50.650255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3601b-a66d-41a6-bfeb-a9242f81a55b None admin] RBAC: Authorizing `identity:create_grant(project_id=2127e9629b274844ac910faf75b3f10a, user_id=318c28a58d7f44de8c470f8453aca6bd, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:50.651713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3601b-a66d-41a6-bfeb-a9242f81a55b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:50.671866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 590/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:17:50 2022] PUT /identity/v3/projects/2127e9629b274844ac910faf75b3f10a/users/318c28a58d7f44de8c470f8453aca6bd/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:17:52.754264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7fe24-5f14-4eac-9409-6c5a0e9f9cf3 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:52.754860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7fe24-5f14-4eac-9409-6c5a0e9f9cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:52.754860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7fe24-5f14-4eac-9409-6c5a0e9f9cf3 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:52.756983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 564/1154] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:52.763371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a841-983b-4f84-aab6-0e5068be33e9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:52.764067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a841-983b-4f84-aab6-0e5068be33e9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:52.764181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1a841-983b-4f84-aab6-0e5068be33e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:52.785573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:52.793843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b9c1a841-983b-4f84-aab6-0e5068be33e9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:52.796805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b9c1a841-983b-4f84-aab6-0e5068be33e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:52.871340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 591/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:17:53.151172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7fe24-5f14-4eac-9409-6c5a0e9f9cf3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:53.190543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:53.275152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7fe24-5f14-4eac-9409-6c5a0e9f9cf3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:53.312570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:53.313199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:53.313481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:53.313749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:53.325657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:17:53.330386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:53.331467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:17:53.332331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 565/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:53.339739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a841-983b-4f84-aab6-0e5068be33e9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:53.442138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1a841-983b-4f84-aab6-0e5068be33e9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:53.480784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:53.481379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:53.481657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:53.481929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:53.482594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:53.482900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:53.484308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:53.486509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:53.493266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 592/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:17:53.502205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:53.595292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:53.613230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1044093-961b-4b83-8188-454f8b1029a9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:53.647709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:53.648315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:53.648588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:53.648853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] PATH_INFO: `/v3/users/318c28a58d7f44de8c470f8453aca6bd` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:53.650014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] RBAC: Authorizing `identity:get_user(user_id=318c28a58d7f44de8c470f8453aca6bd)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:53.651408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:53.653442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 566/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:17:53 2022] GET /identity/v3/users/318c28a58d7f44de8c470f8453aca6bd => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:53.659406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:53.778774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e93ab-1471-40a7-bfc6-f9a4167d7684 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:53.815347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:53.815977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:53.816257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:53.816521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:53.882162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:53.885602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:53.887271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:53.985771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 593/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:53.995372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:54.098598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34740f75-1dce-4c14-b00f-6fb701b50c73 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:54.137728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697f97a-a7b4-49f7-820e-91280860a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:54.138352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697f97a-a7b4-49f7-820e-91280860a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:54.138626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697f97a-a7b4-49f7-820e-91280860a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:54.138895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697f97a-a7b4-49f7-820e-91280860a8c5 None admin] PATH_INFO: `/v3/projects/2127e9629b274844ac910faf75b3f10a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:54.140063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697f97a-a7b4-49f7-820e-91280860a8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=2127e9629b274844ac910faf75b3f10a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:54.141501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697f97a-a7b4-49f7-820e-91280860a8c5 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:54.143121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 567/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:17:53 2022] GET /identity/v3/projects/2127e9629b274844ac910faf75b3f10a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:54.150418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:54.259331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:54.264040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f8adc-6f61-4288-89f6-5c723d672f93 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:54.299778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293090f-2483-4ca5-8695-cf08859de2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:54.300389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293090f-2483-4ca5-8695-cf08859de2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:54.300629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293090f-2483-4ca5-8695-cf08859de2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:54.300926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293090f-2483-4ca5-8695-cf08859de2f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:54.301646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293090f-2483-4ca5-8695-cf08859de2f7 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=2127e9629b274844ac910faf75b3f10a, user.id=318c28a58d7f44de8c470f8453aca6bd) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:54.301956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293090f-2483-4ca5-8695-cf08859de2f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:54.303396 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293090f-2483-4ca5-8695-cf08859de2f7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:54.309380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 594/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:17:54 2022] GET /identity/v3/role_assignments?user.id=318c28a58d7f44de8c470f8453aca6bd&scope.project.id=2127e9629b274844ac910faf75b3f10a&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:56.519781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dae66-5d09-4b0c-87af-4d4d96e094ed None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:56.520637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dae66-5d09-4b0c-87af-4d4d96e094ed None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:56.520637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dae66-5d09-4b0c-87af-4d4d96e094ed None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:56.522802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 568/1162] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:56.528454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58275c-23de-4c04-80b7-7392c36d23c1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:56.528876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58275c-23de-4c04-80b7-7392c36d23c1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:56.528965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58275c-23de-4c04-80b7-7392c36d23c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:56.560230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ed58275c-23de-4c04-80b7-7392c36d23c1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:56.561348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ed58275c-23de-4c04-80b7-7392c36d23c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:56.631120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 595/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:17:56.895427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dae66-5d09-4b0c-87af-4d4d96e094ed None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:56.922325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:57.008290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dae66-5d09-4b0c-87af-4d4d96e094ed None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:57.046023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:57.046622 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:57.046903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:57.047178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:57.116702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:57.118167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:57.138768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:57.222834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 569/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:17:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:17:57.232273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58275c-23de-4c04-80b7-7392c36d23c1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:57.336087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:57.346587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58275c-23de-4c04-80b7-7392c36d23c1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:57.384038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768b0dc-0964-4ffe-b19b-ba9b4f8beff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:57.384657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b0dc-0964-4ffe-b19b-ba9b4f8beff8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:57.384936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b0dc-0964-4ffe-b19b-ba9b4f8beff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:57.385204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768b0dc-0964-4ffe-b19b-ba9b4f8beff8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:57.391951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768b0dc-0964-4ffe-b19b-ba9b4f8beff8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:57.393392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768b0dc-0964-4ffe-b19b-ba9b4f8beff8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-c768b0dc-0964-4ffe-b19b-ba9b4f8beff8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:17:57.404452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:17:57.405597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:17:57.407097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 596/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:17:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:17:57.414740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:17:57.521598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da27b19-23f4-45e5-bb9e-a0f2ac42337b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:17:57.550133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:17:57.569610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfea7d-1a0a-4597-9dfb-513752db9f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:17:57.570220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfea7d-1a0a-4597-9dfb-513752db9f11 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:57.570500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfea7d-1a0a-4597-9dfb-513752db9f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:57.570773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfea7d-1a0a-4597-9dfb-513752db9f11 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:57.571419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfea7d-1a0a-4597-9dfb-513752db9f11 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:17:57.571765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfea7d-1a0a-4597-9dfb-513752db9f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:17:57.573149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfea7d-1a0a-4597-9dfb-513752db9f11 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:17:57.580648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 570/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Mon Sep 26 05:17:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:17:59.693172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dba3e-49aa-4c9b-8efb-8f252d93af50 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:59.693762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dba3e-49aa-4c9b-8efb-8f252d93af50 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:59.693762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dba3e-49aa-4c9b-8efb-8f252d93af50 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:59.695077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 597/1167] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:17:59.701750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a366e-3834-462e-8629-2dc8e0ea4836 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:17:59.702529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a366e-3834-462e-8629-2dc8e0ea4836 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:17:59.702651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a366e-3834-462e-8629-2dc8e0ea4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:17:59.727256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-648a366e-3834-462e-8629-2dc8e0ea4836 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:17:59.728472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-648a366e-3834-462e-8629-2dc8e0ea4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:17:59.799270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 571/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:17:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:18:00.066663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dba3e-49aa-4c9b-8efb-8f252d93af50 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:00.180055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dba3e-49aa-4c9b-8efb-8f252d93af50 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:00.229095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c0228-e68a-496a-80ed-d3931e98bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:00.229681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0228-e68a-496a-80ed-d3931e98bd51 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:00.230105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0228-e68a-496a-80ed-d3931e98bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:00.230561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c0228-e68a-496a-80ed-d3931e98bd51 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:00.231282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0228-e68a-496a-80ed-d3931e98bd51 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:00.232673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c0228-e68a-496a-80ed-d3931e98bd51 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:00.258868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 598/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Mon Sep 26 05:18:00 2022] POST /identity/v3/domains => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:18:02.408356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e083257-db08-449b-a6ed-78f4ed35e4bf None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:02.409206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e083257-db08-449b-a6ed-78f4ed35e4bf None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:02.409206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e083257-db08-449b-a6ed-78f4ed35e4bf None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:02.411348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 572/1170] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:18:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:18:02.417920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8de15a-f0c6-4eec-a29a-1f3fd48327e8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:02.418345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8de15a-f0c6-4eec-a29a-1f3fd48327e8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:02.418433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8de15a-f0c6-4eec-a29a-1f3fd48327e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:02.438207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3f8de15a-f0c6-4eec-a29a-1f3fd48327e8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:18:02.439397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3f8de15a-f0c6-4eec-a29a-1f3fd48327e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:18:02.446598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:02.523345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 599/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:18:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:18:02.796555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e083257-db08-449b-a6ed-78f4ed35e4bf None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:02.910626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e083257-db08-449b-a6ed-78f4ed35e4bf None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:02.925333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:02.947635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497110-e1c2-481c-af0e-9ea02de87d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:02.948260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497110-e1c2-481c-af0e-9ea02de87d60 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:02.948707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497110-e1c2-481c-af0e-9ea02de87d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:02.949106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497110-e1c2-481c-af0e-9ea02de87d60 None admin] PATH_INFO: `/v3/domains/cfd7e7059f1d41b3a86ff093048a62e4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:02.959698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c497110-e1c2-481c-af0e-9ea02de87d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cfd7e7059f1d41b3a86ff093048a62e4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:02.961141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c497110-e1c2-481c-af0e-9ea02de87d60 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:02.962708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 573/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Sep 26 05:18:02 2022] GET /identity/v3/domains/cfd7e7059f1d41b3a86ff093048a62e4 => generated 267 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:02.968955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8de15a-f0c6-4eec-a29a-1f3fd48327e8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:03.071635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8de15a-f0c6-4eec-a29a-1f3fd48327e8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:03.106407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14293ba-12b6-4c87-b074-be462c1ac218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:03.106999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14293ba-12b6-4c87-b074-be462c1ac218 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:03.107273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14293ba-12b6-4c87-b074-be462c1ac218 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:03.107632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14293ba-12b6-4c87-b074-be462c1ac218 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:03.108214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14293ba-12b6-4c87-b074-be462c1ac218 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:03.109628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14293ba-12b6-4c87-b074-be462c1ac218 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:03.124216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:03.141434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 600/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:18:02 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:18:05.292969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d771e-3edb-4d8d-bae6-93ca0af21f8b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:05.293413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d771e-3edb-4d8d-bae6-93ca0af21f8b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:05.293527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d771e-3edb-4d8d-bae6-93ca0af21f8b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:05.294836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 574/1174] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:18:05.300231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3259f-0dba-4503-90da-b9f99d124152 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:05.300674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3259f-0dba-4503-90da-b9f99d124152 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:05.300764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3259f-0dba-4503-90da-b9f99d124152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:05.319912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e8b3259f-0dba-4503-90da-b9f99d124152 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:18:05.321083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e8b3259f-0dba-4503-90da-b9f99d124152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:18:05.393359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 601/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:18:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:18:05.658866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d771e-3edb-4d8d-bae6-93ca0af21f8b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:05.780839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d771e-3edb-4d8d-bae6-93ca0af21f8b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:05.817414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff745a52-98cc-4e66-963f-f0e93e5fb0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:05.818036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff745a52-98cc-4e66-963f-f0e93e5fb0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:05.818317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff745a52-98cc-4e66-963f-f0e93e5fb0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:05.818590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff745a52-98cc-4e66-963f-f0e93e5fb0e7 None admin] PATH_INFO: `/v3/domains/cfd7e7059f1d41b3a86ff093048a62e4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:05.819747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff745a52-98cc-4e66-963f-f0e93e5fb0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cfd7e7059f1d41b3a86ff093048a62e4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:05.821210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff745a52-98cc-4e66-963f-f0e93e5fb0e7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:05.822758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 575/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Mon Sep 26 05:18:05 2022] GET /identity/v3/domains/cfd7e7059f1d41b3a86ff093048a62e4 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:05.832140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3259f-0dba-4503-90da-b9f99d124152 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:05.938809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3259f-0dba-4503-90da-b9f99d124152 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:05.968990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:05.984771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0f521-e361-4e1c-813c-581ee5f6cfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:05.985382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0f521-e361-4e1c-813c-581ee5f6cfe8 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:05.985658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0f521-e361-4e1c-813c-581ee5f6cfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:05.985940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0f521-e361-4e1c-813c-581ee5f6cfe8 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:05.986585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0f521-e361-4e1c-813c-581ee5f6cfe8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:05.988072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0f521-e361-4e1c-813c-581ee5f6cfe8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:06.011045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 602/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:18:05 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:18:08.229377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c7b72-aac2-49b1-8830-6e122c8c3431 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:08.230076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c7b72-aac2-49b1-8830-6e122c8c3431 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:08.230076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c7b72-aac2-49b1-8830-6e122c8c3431 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:08.232201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 576/1178] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:18:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:18:08.241274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6234-1e75-41e2-95d3-ffb051a156c3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:08.241687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6234-1e75-41e2-95d3-ffb051a156c3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:08.242059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a6234-1e75-41e2-95d3-ffb051a156c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:08.268905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a91a6234-1e75-41e2-95d3-ffb051a156c3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:18:08.270117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a91a6234-1e75-41e2-95d3-ffb051a156c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:18:08.343595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 603/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:18:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:18:08.612572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c7b72-aac2-49b1-8830-6e122c8c3431 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:08.662891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:08.734422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c7b72-aac2-49b1-8830-6e122c8c3431 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:08.768641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:08.769262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:08.769543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:08.769811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:08.780377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:18:08.785098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:18:08.786202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:18:08.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 577/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:18:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:18:08.794955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a6234-1e75-41e2-95d3-ffb051a156c3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:08.896199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a6234-1e75-41e2-95d3-ffb051a156c3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:08.908769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:08.933207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:08.933819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:08.934088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:08.934359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:08.935026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:18:08.935329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:08.937083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:08.945160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 604/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:18:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:18:08.952687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:09.067394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbca9b8-64f7-4823-8fc4-3302c8457b91 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:09.069124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:09.109661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:09.110283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:09.110562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:09.110913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] PATH_INFO: `/v3/users/e81dd0a073fd413d860bd231439499ef` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:09.124410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] RBAC: Authorizing `identity:get_user(user_id=e81dd0a073fd413d860bd231439499ef)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:09.125857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:09.127442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 578/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:18:08 2022] GET /identity/v3/users/e81dd0a073fd413d860bd231439499ef => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:09.134100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:09.247210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8906b6-dfe9-4a61-8c5b-5b97a01790f0 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:09.281680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695035-28bb-4290-be85-17598f632daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:09.282284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695035-28bb-4290-be85-17598f632daa None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:09.282563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695035-28bb-4290-be85-17598f632daa None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:09.282831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695035-28bb-4290-be85-17598f632daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:09.325075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:09.353329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62695035-28bb-4290-be85-17598f632daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:09.354947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62695035-28bb-4290-be85-17598f632daa None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:09.459260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 605/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:18:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:18:09.467379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:09.585469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488fa17-3c53-4731-834b-f300cc99c2fb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:09.620643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7e060-4d3f-442e-86db-32ba7353537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:09.621273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7e060-4d3f-442e-86db-32ba7353537e None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:09.621545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7e060-4d3f-442e-86db-32ba7353537e None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:09.621810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7e060-4d3f-442e-86db-32ba7353537e None admin] PATH_INFO: `/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:09.623038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7e060-4d3f-442e-86db-32ba7353537e None admin] RBAC: Authorizing `identity:get_project(project_id=1d5731fd6fc24ccea90a481da2a5bf9c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:09.624498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7e060-4d3f-442e-86db-32ba7353537e None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:09.626085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 579/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:18:09 2022] GET /identity/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:09.635921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695035-28bb-4290-be85-17598f632daa None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:09.717340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:09.755682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695035-28bb-4290-be85-17598f632daa None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:09.794341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c4269-25ad-4b7b-b880-3bb430c7d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:09.794942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c4269-25ad-4b7b-b880-3bb430c7d26d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:09.795223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c4269-25ad-4b7b-b880-3bb430c7d26d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:09.795489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c4269-25ad-4b7b-b880-3bb430c7d26d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:09.796282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c4269-25ad-4b7b-b880-3bb430c7d26d None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=1d5731fd6fc24ccea90a481da2a5bf9c, user.id=e81dd0a073fd413d860bd231439499ef) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:18:09.796590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c4269-25ad-4b7b-b880-3bb430c7d26d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:09.798040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c4269-25ad-4b7b-b880-3bb430c7d26d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:09.803495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 606/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:18:09 2022] GET /identity/v3/role_assignments?user.id=e81dd0a073fd413d860bd231439499ef&scope.project.id=1d5731fd6fc24ccea90a481da2a5bf9c&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:11.919466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb414-2738-4308-8b2b-5bc1c7419435 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:11.920131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb414-2738-4308-8b2b-5bc1c7419435 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:11.920131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb414-2738-4308-8b2b-5bc1c7419435 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:11.921385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 580/1186] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:18:11.927776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfeab-bf38-4609-ac94-6e5d0fa68cd7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:11.928509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfeab-bf38-4609-ac94-6e5d0fa68cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:11.928663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbfeab-bf38-4609-ac94-6e5d0fa68cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:11.951675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5dbbfeab-bf38-4609-ac94-6e5d0fa68cd7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:18:11.952884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5dbbfeab-bf38-4609-ac94-6e5d0fa68cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:18:12.022642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 607/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:18:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:18:12.295794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb414-2738-4308-8b2b-5bc1c7419435 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:12.328984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:12.411130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb414-2738-4308-8b2b-5bc1c7419435 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:12.450099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:12.450725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:12.451004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:12.451275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:12.462776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:18:12.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:18:12.468885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:18:12.470075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:18:12.471733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 581/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:18:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:18:12.475592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbfeab-bf38-4609-ac94-6e5d0fa68cd7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:12.548275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:12.588346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbfeab-bf38-4609-ac94-6e5d0fa68cd7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:12.629079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:12.629693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:12.629973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:12.630246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:12.630915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:18:12.631221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:12.632633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:12.641137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 608/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:18:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:12.647209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:12.744106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:12.764308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd702c9-0e69-4711-b995-008d60bc4a9c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:12.799729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:12.800280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:12.800553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:12.800839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] PATH_INFO: `/v3/users/e81dd0a073fd413d860bd231439499ef` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:12.801927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] RBAC: Authorizing `identity:get_user(user_id=e81dd0a073fd413d860bd231439499ef)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:12.803356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:12.804938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 582/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:18:12 2022] GET /identity/v3/users/e81dd0a073fd413d860bd231439499ef => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:12.814840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:12.927568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bd3e9-3d79-4e9d-9e84-40b6c8b26f82 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:12.954210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:12.966765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cff9b-fe8e-4ab9-9c5e-b9cbe920b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:12.967824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cff9b-fe8e-4ab9-9c5e-b9cbe920b330 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:12.968239 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cff9b-fe8e-4ab9-9c5e-b9cbe920b330 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:12.968645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cff9b-fe8e-4ab9-9c5e-b9cbe920b330 None admin] PATH_INFO: `/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:12.970615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cff9b-fe8e-4ab9-9c5e-b9cbe920b330 None admin] RBAC: Authorizing `identity:get_project(project_id=1d5731fd6fc24ccea90a481da2a5bf9c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:12.972962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cff9b-fe8e-4ab9-9c5e-b9cbe920b330 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:12.975604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 609/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:18:12 2022] GET /identity/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:12.982032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:13.087607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3fe85-9cb5-4e25-98cf-b2ae0e27e466 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:13.124909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7bb19-7e28-4ce9-9b3f-7339bbc1678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:13.125558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7bb19-7e28-4ce9-9b3f-7339bbc1678a None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:13.125838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7bb19-7e28-4ce9-9b3f-7339bbc1678a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:13.126105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7bb19-7e28-4ce9-9b3f-7339bbc1678a None admin] PATH_INFO: `/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c/users/e81dd0a073fd413d860bd231439499ef/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:13.128189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7bb19-7e28-4ce9-9b3f-7339bbc1678a None admin] RBAC: Authorizing `identity:create_grant(project_id=1d5731fd6fc24ccea90a481da2a5bf9c, user_id=e81dd0a073fd413d860bd231439499ef, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:13.129635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7bb19-7e28-4ce9-9b3f-7339bbc1678a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:13.152374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 583/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:18:12 2022] PUT /identity/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c/users/e81dd0a073fd413d860bd231439499ef/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:18:15.268277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf935-c3a8-4d05-a8df-5f64c9b287cb None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:15.268874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf935-c3a8-4d05-a8df-5f64c9b287cb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:15.268874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaf935-c3a8-4d05-a8df-5f64c9b287cb None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:15.270193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 610/1193] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:18:15.277587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732fc7c-62b7-4354-9db9-671c105d8b3c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:15.278313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732fc7c-62b7-4354-9db9-671c105d8b3c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:15.278479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732fc7c-62b7-4354-9db9-671c105d8b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:15.303115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7732fc7c-62b7-4354-9db9-671c105d8b3c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:18:15.304356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7732fc7c-62b7-4354-9db9-671c105d8b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:18:15.316236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:15.385208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 584/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:18:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:18:15.650685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf935-c3a8-4d05-a8df-5f64c9b287cb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:15.767750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaf935-c3a8-4d05-a8df-5f64c9b287cb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:15.806208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:15.806830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:15.807107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:15.807438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:15.818741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:18:15.823769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:18:15.824842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:18:15.825848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:18:15.827729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 611/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:18:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:18:15.831184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732fc7c-62b7-4354-9db9-671c105d8b3c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:15.949888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732fc7c-62b7-4354-9db9-671c105d8b3c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:15.986757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:15.987372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:15.987685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:15.987962 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:15.988633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:18:15.988937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:15.990330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:15.999754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 585/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:18:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:16.006732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:16.074649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:16.128842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce34426-f7b2-4da6-a3e7-ccbdb86cf15c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:16.181690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:16.183180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:16.183468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:16.183773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] PATH_INFO: `/v3/users/e81dd0a073fd413d860bd231439499ef` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:16.185661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] RBAC: Authorizing `identity:get_user(user_id=e81dd0a073fd413d860bd231439499ef)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:16.188069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:16.190761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 612/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Mon Sep 26 05:18:16 2022] GET /identity/v3/users/e81dd0a073fd413d860bd231439499ef => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:16.199388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:16.214950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:16.338923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff481e5a-1b8b-4eb2-a830-37f3edc6a864 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:16.389765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:16.390560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:16.390845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:16.391215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:16.477959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:16.479385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:16.491255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:16.602069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 586/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:18:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:18:16.611174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:16.731368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fc777-0fbd-4028-a4c5-b110b61b6418 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:16.758333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:16.770523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241903e-e641-4489-8ce7-1ea2f166f5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:16.771151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241903e-e641-4489-8ce7-1ea2f166f5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:16.771419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241903e-e641-4489-8ce7-1ea2f166f5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:16.771719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241903e-e641-4489-8ce7-1ea2f166f5a0 None admin] PATH_INFO: `/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:16.772854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241903e-e641-4489-8ce7-1ea2f166f5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1d5731fd6fc24ccea90a481da2a5bf9c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:16.774272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241903e-e641-4489-8ce7-1ea2f166f5a0 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:16.775973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 613/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Mon Sep 26 05:18:16 2022] GET /identity/v3/projects/1d5731fd6fc24ccea90a481da2a5bf9c => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:16.785334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:18:16.917460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3456977d-6f1c-4d8d-bd85-476907dc5108 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:18:16.928067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:16.956679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c26d4-e4f6-4bde-9858-28cf6e8df25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:18:16.957309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c26d4-e4f6-4bde-9858-28cf6e8df25c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:18:16.957588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c26d4-e4f6-4bde-9858-28cf6e8df25c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:18:16.957851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c26d4-e4f6-4bde-9858-28cf6e8df25c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:18:16.958571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c26d4-e4f6-4bde-9858-28cf6e8df25c None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=1d5731fd6fc24ccea90a481da2a5bf9c, user.id=e81dd0a073fd413d860bd231439499ef) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:18:16.958874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c26d4-e4f6-4bde-9858-28cf6e8df25c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:18:16.960341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c26d4-e4f6-4bde-9858-28cf6e8df25c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:18:16.966501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 587/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:18:16 2022] GET /identity/v3/role_assignments?user.id=e81dd0a073fd413d860bd231439499ef&scope.project.id=1d5731fd6fc24ccea90a481da2a5bf9c&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:18:26.765806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:18:26.963536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=14 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:13.182346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861228a-a5d6-41e2-a058-70f4aa08eba4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:13.183005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861228a-a5d6-41e2-a058-70f4aa08eba4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:13.183005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861228a-a5d6-41e2-a058-70f4aa08eba4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:13.184836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 614/1201] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:19:13.191431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff0e5d-87aa-4a60-9676-363b7452380d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:13.191970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff0e5d-87aa-4a60-9676-363b7452380d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:13.192166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff0e5d-87aa-4a60-9676-363b7452380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:13.215011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a9ff0e5d-87aa-4a60-9676-363b7452380d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:13.216494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a9ff0e5d-87aa-4a60-9676-363b7452380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:13.312936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 588/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:13.589131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861228a-a5d6-41e2-a058-70f4aa08eba4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:13.703597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861228a-a5d6-41e2-a058-70f4aa08eba4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:13.741629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:13.742255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:13.742540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:13.742856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:13.754116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:13.755597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:13.772305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:13.773727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:13.775112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:13.775112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:13.775112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:13.775112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 615/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:13.781101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff0e5d-87aa-4a60-9676-363b7452380d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:13.906923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff0e5d-87aa-4a60-9676-363b7452380d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:13.952372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:13.966804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e87da-91fc-4372-a821-d6196323e3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:13.967538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e87da-91fc-4372-a821-d6196323e3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:13.967949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e87da-91fc-4372-a821-d6196323e3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:13.968301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e87da-91fc-4372-a821-d6196323e3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:13.969065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e87da-91fc-4372-a821-d6196323e3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:13.969440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e87da-91fc-4372-a821-d6196323e3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:13.970981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e87da-91fc-4372-a821-d6196323e3d8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:13.985510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 589/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:13.991753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:14.062718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:14.129388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715ab0f-3bce-4792-9b3e-6d7cc11fde69 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:14.174463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc87d7-6c99-49d3-97bc-a3c667727afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:14.175525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc87d7-6c99-49d3-97bc-a3c667727afd None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:14.176139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc87d7-6c99-49d3-97bc-a3c667727afd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:14.176607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc87d7-6c99-49d3-97bc-a3c667727afd None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:14.177493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc87d7-6c99-49d3-97bc-a3c667727afd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:14.179352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cc87d7-6c99-49d3-97bc-a3c667727afd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:14.204034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 616/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Mon Sep 26 05:19:13 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:19:16.691795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc2d3-cc59-4256-80a8-e89cf777af63 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:16.692370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc2d3-cc59-4256-80a8-e89cf777af63 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:16.692463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bc2d3-cc59-4256-80a8-e89cf777af63 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:16.693981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 590/1206] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:16.699905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946f67-ac03-4ec2-a23f-2726367d8d06 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:16.700402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946f67-ac03-4ec2-a23f-2726367d8d06 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:16.700493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946f67-ac03-4ec2-a23f-2726367d8d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:16.720405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-73946f67-ac03-4ec2-a23f-2726367d8d06 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:16.721618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-73946f67-ac03-4ec2-a23f-2726367d8d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:16.799482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 617/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:17.089567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc2d3-cc59-4256-80a8-e89cf777af63 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:17.211625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bc2d3-cc59-4256-80a8-e89cf777af63 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:17.251371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:17.252056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:17.252335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:17.252638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:17.265666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:19:17.270899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:17.271984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:17.273506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 591/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:19:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:17.284580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73946f67-ac03-4ec2-a23f-2726367d8d06 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:17.329817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:17.400537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73946f67-ac03-4ec2-a23f-2726367d8d06 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:17.437871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:17.438532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:17.438814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:17.439083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:17.439823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:17.440130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:17.442714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:17.451909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 618/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:19:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:17.456282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:17.509882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:17.569035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffae95-01e2-463e-8304-d074b1c942eb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:17.609042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:17.609691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:17.609951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:17.610216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:17.622143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:17.623653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:17.639834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:17.640922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:17.641834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:17.641834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:17.641834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:17.641834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 592/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:17.647093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:17.758280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:17.761425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c692459-4cef-4422-a22c-4a0fdc0253b7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:17.802047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:17.803416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:17.803416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:17.803416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:17.803928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:17.804232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:17.805709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:17.824455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 619/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:17.826349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:17.964860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4f722-b84e-4dc2-b28b-9f4668498607 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:17.966876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:18.017610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:18.018414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:18.018717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:18.019174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:18.030035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:18.031826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:19:18.045775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:18.047397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:18.048515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 593/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:18.053344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:18.172680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d592b-25b2-402b-b044-11c6282d10cd None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:18.213244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:18.213889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:18.214167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:18.214438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:18.216172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:18.216700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:18.218426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:18.240594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 620/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 05:19:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:18.247453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:18.396366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1b12d-c3ae-41cf-9df8-371ff3bf4a23 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:18.444852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:18.445566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:18.445849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:18.446120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:18.488636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:18.535857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:18.537661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:18.651872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 594/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:19:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:19:18.653732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:18.678559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:18.788673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c90aa-13f6-49ae-9fb0-72f9665aa718 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:18.829652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:18.830385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:18.830692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:18.830997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:18.843976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:18.845467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:18.862651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:18.863799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:18.864748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:18.864748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:18.864748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:18.864748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 621/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:18.870489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:18.955492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:18.999690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb790147-1c7e-4257-a3ac-59276f999bca None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:19.037733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:19.038332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:19.038640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:19.038951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:19.039521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:19.039845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:19.041230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:19.054216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 595/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:19.060927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:19.135977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:19.178075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c013-bf8c-41e8-9174-96f29331952c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:19.224572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:19.225205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:19.225484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:19.225778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:19.233493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:19.235048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:19:19.246739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:19.247974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:19.249121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 622/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:19.256971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:19.378402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b1bf6-defd-4510-b82e-0e8755c0d50c None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:19.405598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:19.419198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163cca-0b70-4fe7-97a5-88aa2803a6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:19.419844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163cca-0b70-4fe7-97a5-88aa2803a6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:19.420125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163cca-0b70-4fe7-97a5-88aa2803a6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:19.420396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163cca-0b70-4fe7-97a5-88aa2803a6f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:19.421091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21163cca-0b70-4fe7-97a5-88aa2803a6f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:19.421405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21163cca-0b70-4fe7-97a5-88aa2803a6f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:19.422854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21163cca-0b70-4fe7-97a5-88aa2803a6f2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:19.436304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 596/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:19:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:19.442953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:19.552361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa3729-a3e5-44ca-af06-c9f92ad1e54f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:19.583084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:19.589669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54b306-80f4-4a3e-96e8-33ead809f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:19.590934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54b306-80f4-4a3e-96e8-33ead809f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:19.591224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54b306-80f4-4a3e-96e8-33ead809f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:19.591567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54b306-80f4-4a3e-96e8-33ead809f9a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:19.592293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54b306-80f4-4a3e-96e8-33ead809f9a8 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=236e8947ce084c019d269170624fa35b) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:19.592646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54b306-80f4-4a3e-96e8-33ead809f9a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:19.594210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54b306-80f4-4a3e-96e8-33ead809f9a8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:19.599934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 623/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:19:19 2022] GET /identity/v3/role_assignments?user.id=236e8947ce084c019d269170624fa35b&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:19:21.881429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21633-3042-4b5e-99e4-7247dfc62236 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:21.882031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21633-3042-4b5e-99e4-7247dfc62236 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:21.882031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc21633-3042-4b5e-99e4-7247dfc62236 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:21.883631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 597/1220] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:19:21.889427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b01b4-9179-451c-a1f3-b2971da51269 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:21.889938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b01b4-9179-451c-a1f3-b2971da51269 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:21.890041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b01b4-9179-451c-a1f3-b2971da51269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:21.908518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-707b01b4-9179-451c-a1f3-b2971da51269 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:21.909729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-707b01b4-9179-451c-a1f3-b2971da51269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:21.985975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 624/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:19:22.276380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc21633-3042-4b5e-99e4-7247dfc62236 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:22.390172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc21633-3042-4b5e-99e4-7247dfc62236 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:22.428466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:22.429106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:22.429400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:22.429649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:22.444034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:19:22.450503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:22.451480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:22.452406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 598/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:19:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:22.458247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b01b4-9179-451c-a1f3-b2971da51269 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:22.566476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b01b4-9179-451c-a1f3-b2971da51269 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:22.592536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:22.604017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:22.604813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:22.605221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:22.605569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:22.606243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] RBAC: Adding query filter params (name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:22.606554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:22.607956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:22.616659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 625/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:19:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:22.622995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:22.667434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:22.731245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b360-0af7-4dd4-ad82-2212548f9ca8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:22.769175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:22.769818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:22.770088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:22.770360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:22.785438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:22.787173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:22.803378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:22.804920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:22.806018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:22.806018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:22.806018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:22.806018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 599/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:22.810902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:22.919313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d1a43-5546-4ee9-b8f3-e38a76a15241 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:22.960686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:22.961288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:22.961559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:22.961831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:22.962456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:22.962770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:22.964149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:22.976488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 626/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:22.982463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:23.083402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:23.090829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56704e9-333b-489f-81eb-b06f630647e2 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:23.127111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:23.128232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:23.128384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:23.128735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:23.138978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:23.140509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:19:23.153598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:23.154779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:23.155923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 600/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:19:23.161169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:23.215225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:23.275214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca72de-7add-4737-94c9-078fbebebcb8 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:23.315814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:23.316442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:23.316700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:23.316967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:23.317691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:23.317990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:23.319424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:23.337080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 627/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 05:19:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:23.343936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:23.463519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14997d20-d288-45b1-9157-bf9e695f1cfc None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:23.502497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:23.503062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:23.503342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:23.503668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:23.516232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:23.517728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:23.533537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:23.534718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:23.535945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:23.535945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:23.535945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:23.535945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 601/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:23.540836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:23.650739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583ee4c-5619-4130-8426-0dae194c9b04 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:23.653212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:23.687569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:23.688208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:23.688487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:23.688759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:23.689445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:23.689773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:23.691352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:23.703173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 628/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:19:23.709566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:23.720130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:23.822297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd455e2-cba5-436d-bbd8-1d67c0210055 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:23.856149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:23.856775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:23.857049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:23.857313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:23.864155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:23.865769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:19:23.878136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:23.879210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:23.880187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 602/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:23.885766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:24.003528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d259bb-3c2a-449c-91c6-50f7a28716c7 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:24.038124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603544cf-8b4d-4926-91df-794d3997eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:24.038773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603544cf-8b4d-4926-91df-794d3997eed3 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:24.039048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603544cf-8b4d-4926-91df-794d3997eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:24.039322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603544cf-8b4d-4926-91df-794d3997eed3 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:24.040069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603544cf-8b4d-4926-91df-794d3997eed3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:24.040395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603544cf-8b4d-4926-91df-794d3997eed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:24.041929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603544cf-8b4d-4926-91df-794d3997eed3 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:24.055444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 629/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:24.062020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:24.130555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:24.168560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059855fe-03b3-48c0-97f0-a51668bbaa20 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:24.205693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42338d-eebe-4363-82e3-a2dc9f7db2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:24.206362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42338d-eebe-4363-82e3-a2dc9f7db2cb None admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:24.206679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42338d-eebe-4363-82e3-a2dc9f7db2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:24.206996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42338d-eebe-4363-82e3-a2dc9f7db2cb None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/236e8947ce084c019d269170624fa35b/roles/1ab617a329104fd79ddc9e4476562ada` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:24.223511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42338d-eebe-4363-82e3-a2dc9f7db2cb None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=236e8947ce084c019d269170624fa35b, role_id=1ab617a329104fd79ddc9e4476562ada)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:24.225083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42338d-eebe-4363-82e3-a2dc9f7db2cb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:24.239657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 603/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:19:24 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/236e8947ce084c019d269170624fa35b/roles/1ab617a329104fd79ddc9e4476562ada => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:19:26.452261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbcd2-a41d-46eb-87c5-163406700e83 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:26.452967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbcd2-a41d-46eb-87c5-163406700e83 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:26.452967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dbcd2-a41d-46eb-87c5-163406700e83 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:26.454364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 630/1233] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:26.460824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b946e7-74ad-4e19-90eb-4a19e5f79ab2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:26.461280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b946e7-74ad-4e19-90eb-4a19e5f79ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:26.461464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b946e7-74ad-4e19-90eb-4a19e5f79ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:26.482681 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b4b946e7-74ad-4e19-90eb-4a19e5f79ab2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:26.484081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b4b946e7-74ad-4e19-90eb-4a19e5f79ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:26.562590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 604/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:26.853174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbcd2-a41d-46eb-87c5-163406700e83 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:26.883606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:26.974929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dbcd2-a41d-46eb-87c5-163406700e83 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:27.013312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:27.014035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:27.014315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:27.014586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:27.025881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:19:27.030690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:27.031918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:27.032923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 631/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Mon Sep 26 05:19:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:27.038392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b946e7-74ad-4e19-90eb-4a19e5f79ab2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:27.092290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:27.156660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b946e7-74ad-4e19-90eb-4a19e5f79ab2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:27.194990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:27.195650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:27.195950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:27.196190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:27.196839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] RBAC: Adding query filter params (name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:27.197170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:27.198503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:27.207146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 605/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Mon Sep 26 05:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:27.213062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:27.306612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:27.324670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ed39f-1095-4d8c-a223-93dfb300c649 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:27.361552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:27.362187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:27.362468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:27.362709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:27.374237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:27.375718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:27.393670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:27.394925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:27.396040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:27.396040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:27.396040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:27.396040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 632/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:27.400850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:27.511186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8642f97-5bb8-49ba-85c9-86ae02dea517 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:27.520703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:27.550644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:27.551322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:27.551565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:27.551850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:27.552502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:27.552805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:27.554190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:27.568147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 606/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:27.573880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:27.682701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464f12b6-e62b-4285-b530-42adc41f3b0c None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:27.721535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:27.722279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:27.722591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:27.722903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:27.726007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:27.732390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:27.734062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:19:27.750146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:27.751350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:27.752767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 633/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:27.757897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:27.865121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b514b-709f-4267-bdc4-a1ec7e81426a None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:27.901373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:27.902111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:27.902409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:27.902682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:27.903416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:27.903770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:27.905231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:27.929355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 607/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 05:19:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:27.930850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:28.051459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017becfb-9ec6-40b0-8c2f-393811f26644 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:28.085531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:28.086237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:28.086514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:28.086783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:28.159562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:28.166757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:28.168528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:28.277856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 634/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:19:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:19:28.283961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:28.315363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:28.396742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b76ca-d18b-4666-841e-ba18e33ddb4b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:28.436844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:28.437269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:28.437497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:28.437762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:28.448348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:28.450740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:28.466386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:28.467426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:28.468362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:28.468362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:28.468362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:28.468362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 608/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:19:28.473430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:28.580248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:28.586432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8ebb6-ed8d-46f8-bc35-e70b0e37d98d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:28.626202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:28.626957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:28.627231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:28.627496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:28.628167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:28.628465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:28.629813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:28.643345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 635/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:28.650634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:28.732796 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:28.755586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cd763-2008-4c04-bb0a-62a78d085e91 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:28.797818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:28.798467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:28.798737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:28.798989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:28.805924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:28.807387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:19:28.819828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:28.820947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:28.821836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 609/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:19:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:28.826928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:28.953100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed41ee1-b3e8-4979-b7c3-b46d03985b8b None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:28.990517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a014e6-f8f9-46c8-8b57-47712b283663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:28.990999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a014e6-f8f9-46c8-8b57-47712b283663 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:28.991281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a014e6-f8f9-46c8-8b57-47712b283663 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:28.991589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a014e6-f8f9-46c8-8b57-47712b283663 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:28.992257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a014e6-f8f9-46c8-8b57-47712b283663 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:28.992561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a014e6-f8f9-46c8-8b57-47712b283663 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:28.993985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a014e6-f8f9-46c8-8b57-47712b283663 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:29.006168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 636/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:19:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:29.012718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:29.123156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b48ed-9f25-4c9b-8d9b-49b35ffe69b7 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:29.159445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da51b68-fb79-41cd-88a2-33e1d3ed63c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:29.160117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da51b68-fb79-41cd-88a2-33e1d3ed63c2 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:29.160397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da51b68-fb79-41cd-88a2-33e1d3ed63c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:29.160669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da51b68-fb79-41cd-88a2-33e1d3ed63c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:29.161429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da51b68-fb79-41cd-88a2-33e1d3ed63c2 None admin] RBAC: Adding query filter params (role.id=1ab617a329104fd79ddc9e4476562ada, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=236e8947ce084c019d269170624fa35b) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:29.161724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da51b68-fb79-41cd-88a2-33e1d3ed63c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:29.163232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da51b68-fb79-41cd-88a2-33e1d3ed63c2 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:29.170047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 610/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:19:29 2022] GET /identity/v3/role_assignments?user.id=236e8947ce084c019d269170624fa35b&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=1ab617a329104fd79ddc9e4476562ada => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:19:31.355085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f57a-f986-473c-81a7-b1ab4d29b868 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:31.355746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f57a-f986-473c-81a7-b1ab4d29b868 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:31.355746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335f57a-f986-473c-81a7-b1ab4d29b868 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:31.357083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 637/1247] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:31.365470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa583-aeb2-436e-8362-cec09313a680 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:31.365906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa583-aeb2-436e-8362-cec09313a680 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:31.366010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fa583-aeb2-436e-8362-cec09313a680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:31.373241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:31.386609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f34fa583-aeb2-436e-8362-cec09313a680 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:31.387847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f34fa583-aeb2-436e-8362-cec09313a680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:31.463339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 611/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:31.749870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335f57a-f986-473c-81a7-b1ab4d29b868 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:31.769254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:31.860165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335f57a-f986-473c-81a7-b1ab4d29b868 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:31.894348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:31.894985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:31.895265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:31.895554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:31.906001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:19:31.910714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:31.911897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:31.912878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 638/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:31.918564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fa583-aeb2-436e-8362-cec09313a680 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:32.028142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fa583-aeb2-436e-8362-cec09313a680 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:32.062192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:32.067450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:32.068186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:32.068486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:32.068734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:32.069610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:32.069980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:32.071890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:32.082649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 612/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:32.088543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:32.170288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:32.193874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551922c8-ff1c-42d2-a37c-62143ce516a5 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:32.230639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:32.231286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:32.231592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:32.231866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:32.243122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:32.244804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:32.265600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:32.266834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:32.267941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:32.267941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:32.267941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:32.267941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 639/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:32.272599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:32.393587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504b05a-4a4f-451b-9edc-f2ee94f05126 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:32.430432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:32.431041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:32.431359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:32.431618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:32.432244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:32.432547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:32.433951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:32.446853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 613/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:19:32.453243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:32.563182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782c6c3-9f06-4319-a2fe-e98f8e813053 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:32.589649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:32.599950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:32.600717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:32.600999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:32.601293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:32.609447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:32.610885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:19:32.622562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:32.623660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:32.624797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:32.627695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 640/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:32.629669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:32.691972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:32.743810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ebf06-0220-4128-a8f1-dcb67f99ef28 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:32.787921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:32.788538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:32.788816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:32.789089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:32.789827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:32.790131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:32.791587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:32.809313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 614/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 05:19:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:32.815400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:32.924043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5b4aa-601d-41ce-b50e-75911360c2a1 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:32.965471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:32.966149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:32.966430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:32.966827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:33.030155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:33.043920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:33.045648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:33.149654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 641/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:19:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:19:33.155825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:33.274528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea4b8e-81a4-43ab-8691-56146cd68ffb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:33.291162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:33.316102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:33.316735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:33.317010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:33.317276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:33.327865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:33.329310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:33.347408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:33.348730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:33.349811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:33.349811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:33.349811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:33.349811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 615/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:33.354551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:33.446521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:33.458960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a29f7-c2f2-4a8e-b972-7ce8af7be3be None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:33.495784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:33.496446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:33.496787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:33.497093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:33.497857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:33.498165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:33.499664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:33.512262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 642/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:33.518272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:33.625258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e248b-50c4-4b6f-8497-f8f16ee73fbb None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:33.662514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:33.663160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:33.663437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:33.663737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:33.672117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:33.673617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:19:33.686315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:33.687366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:33.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 616/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:33.693706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:33.802855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd7e4d-5a80-47da-83f4-a948ad7e7ac9 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:33.840177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830b79f-893f-48e7-8ef9-28cb4ff061b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:33.840807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830b79f-893f-48e7-8ef9-28cb4ff061b4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:33.841144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830b79f-893f-48e7-8ef9-28cb4ff061b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:33.841410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830b79f-893f-48e7-8ef9-28cb4ff061b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:33.842136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830b79f-893f-48e7-8ef9-28cb4ff061b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:33.842432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830b79f-893f-48e7-8ef9-28cb4ff061b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:33.843906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830b79f-893f-48e7-8ef9-28cb4ff061b4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:33.857102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 643/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:33.863457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:33.894053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:33.985965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f4984-b1ae-4421-b2c6-15604dd1f43b None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:34.021356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702db106-5184-4207-bc07-0a6b0fd738d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:34.021969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db106-5184-4207-bc07-0a6b0fd738d9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:34.022219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db106-5184-4207-bc07-0a6b0fd738d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:34.022515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db106-5184-4207-bc07-0a6b0fd738d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:34.023241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702db106-5184-4207-bc07-0a6b0fd738d9 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=236e8947ce084c019d269170624fa35b) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:34.023581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702db106-5184-4207-bc07-0a6b0fd738d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:34.025010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702db106-5184-4207-bc07-0a6b0fd738d9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:34.032082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 617/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:19:33 2022] GET /identity/v3/role_assignments?user.id=236e8947ce084c019d269170624fa35b&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:36.180936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6be13-194c-4804-962d-bbc747b10f95 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:36.181816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6be13-194c-4804-962d-bbc747b10f95 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:36.181816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6be13-194c-4804-962d-bbc747b10f95 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:36.184071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 644/1261] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:36.193349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0107-127e-437e-9cd1-a9c042b79b46 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:36.194104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0107-127e-437e-9cd1-a9c042b79b46 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:36.194256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c0107-127e-437e-9cd1-a9c042b79b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:36.215533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-229c0107-127e-437e-9cd1-a9c042b79b46 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:36.216744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-229c0107-127e-437e-9cd1-a9c042b79b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:36.290432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 618/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:36.553596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6be13-194c-4804-962d-bbc747b10f95 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:36.567980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:36.664777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6be13-194c-4804-962d-bbc747b10f95 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:36.700981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:36.701592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:36.701868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:36.702135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:36.713458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:19:36.718246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:36.719348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:36.720417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 645/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:36.726150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c0107-127e-437e-9cd1-a9c042b79b46 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:36.746991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:36.837354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c0107-127e-437e-9cd1-a9c042b79b46 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:36.879356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:36.879990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:36.880276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:36.880543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:36.881207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:36.881510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:36.882895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:36.891229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 619/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:19:36.897999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:36.980704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:37.016236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef32ba-c98c-44e8-8011-4fa2a62cd52f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:37.050730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:37.051381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:37.051691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:37.051990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:37.062950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:37.064421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:37.079082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:37.080152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:37.081223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:37.081223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:37.081223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:37.081223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 646/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:37.086194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:37.182074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:37.203500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99e4e3-fab6-49ff-bb34-3029c9392740 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:37.238298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:37.238892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:37.239163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:37.239429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:37.240116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:37.240394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:37.241756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:37.253523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 620/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:37.259757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:37.362477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ef8a2-8cf7-4e93-aa38-efa4591e193d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:37.386753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:37.403508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:37.404419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:37.404758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:37.405094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:37.416491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:37.418383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:19:37.429415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:37.430468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:37.431837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 647/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:37.437604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:37.545224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa5d29-e15f-4c08-bf94-11fad09c05c8 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:37.584920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:37.585517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:37.585791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:37.586062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:37.586782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:37.587092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:37.588570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:37.598118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:37.610181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 621/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 05:19:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:37.616533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:37.722991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28405f-b903-4ebf-a756-916dfaf55c9f None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:37.756894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:37.757511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:37.757785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:37.758046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:37.768972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:37.770416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:37.784735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:37.785806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:37.786953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:37.786953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:37.786953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:37.786953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 648/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:37.792407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:37.909882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace70778-cf87-487c-8a26-664f028c61c9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:37.953438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:37.954120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:37.954405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:37.954675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:37.955320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:37.955652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:37.957024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:37.968471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 622/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:37.974952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:38.009454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:38.086135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4a79c-7ee9-435b-8c46-83075b223d33 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:38.121536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:38.122154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:38.122431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:38.122703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:38.129638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:38.131071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:19:38.142551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:38.143596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:38.144509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 649/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:38.152622 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:38.222482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:38.281099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cec2e1-658f-47e1-8a4f-7ae96c2e9ee3 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:38.318261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92a2be-78bd-4cbf-b0f1-880aeb2dc8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:38.318860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a2be-78bd-4cbf-b0f1-880aeb2dc8ea None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:38.319106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a2be-78bd-4cbf-b0f1-880aeb2dc8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:38.319371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92a2be-78bd-4cbf-b0f1-880aeb2dc8ea None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:38.320084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92a2be-78bd-4cbf-b0f1-880aeb2dc8ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:38.320381 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92a2be-78bd-4cbf-b0f1-880aeb2dc8ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:38.321809 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92a2be-78bd-4cbf-b0f1-880aeb2dc8ea None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:38.333870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 623/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:38.340255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:38.444120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:38.453419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad2da5-4c8b-46e2-b1be-4f9547a42000 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:38.487017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeebcc-0b9a-4281-b3e0-d8cfc56756dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:38.487692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeebcc-0b9a-4281-b3e0-d8cfc56756dd None admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:38.487964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeebcc-0b9a-4281-b3e0-d8cfc56756dd None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:38.488232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeebcc-0b9a-4281-b3e0-d8cfc56756dd None admin] PATH_INFO: `/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/236e8947ce084c019d269170624fa35b/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:38.490110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeebcc-0b9a-4281-b3e0-d8cfc56756dd None admin] RBAC: Authorizing `identity:create_grant(project_id=6db4696e870e4131aa66e3a7908c8928, user_id=236e8947ce084c019d269170624fa35b, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:38.491523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeebcc-0b9a-4281-b3e0-d8cfc56756dd None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:38.507366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 650/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Mon Sep 26 05:19:38 2022] PUT /identity/v3/projects/6db4696e870e4131aa66e3a7908c8928/users/236e8947ce084c019d269170624fa35b/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:19:40.631400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63eb8-b891-45ad-874f-bb1794135dcd None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:40.632302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63eb8-b891-45ad-874f-bb1794135dcd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:40.632302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c63eb8-b891-45ad-874f-bb1794135dcd None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:40.634391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 624/1274] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:40.641627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950852c0-ce74-4662-8e69-17d5d30f9879 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:40.642071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950852c0-ce74-4662-8e69-17d5d30f9879 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:40.642161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950852c0-ce74-4662-8e69-17d5d30f9879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:40.666393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-950852c0-ce74-4662-8e69-17d5d30f9879 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:40.667674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-950852c0-ce74-4662-8e69-17d5d30f9879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:40.738896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 651/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:19:41.014586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c63eb8-b891-45ad-874f-bb1794135dcd None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:41.143411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c63eb8-b891-45ad-874f-bb1794135dcd None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:41.161279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:41.179405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:41.180065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:41.180343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:41.180617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:41.191737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:19:41.196548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:41.197610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:41.198756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 625/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Mon Sep 26 05:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:41.204122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950852c0-ce74-4662-8e69-17d5d30f9879 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:41.295945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:41.324899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950852c0-ce74-4662-8e69-17d5d30f9879 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:41.363388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:41.364016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:41.364287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:41.364552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:41.365206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:41.365507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:41.366846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:41.375175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 652/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Mon Sep 26 05:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:41.381978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:41.498952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4e15-9bac-404f-9c80-249bf2d3b894 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:41.534830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:41.535514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:41.535730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:41.536026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:41.554268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:41.555769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:41.571696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:41.572798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:41.573770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:41.573770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:41.573770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:41.573770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 626/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:41.581304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:41.685966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f8e38-5faf-4819-b28e-30378fc3bc5d None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:41.721341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:41.721938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:41.722206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:41.722473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:41.723099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:41.723390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:41.724771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:41.736502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 653/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:19:41.742774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:41.778218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:41.853677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f583725-e352-477b-aa1d-61c7615882b9 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:41.895321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:41.895976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:41.896256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:41.896530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:41.904558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:41.906014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:19:41.918098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:41.919232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:41.920432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 627/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:41.927342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:41.932887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:42.036880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc414384-2798-4a4b-8b29-7590030c0755 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:42.072135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:42.072735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:42.073014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:42.073283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:42.074073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:42.074366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:42.075823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:42.092705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 654/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Mon Sep 26 05:19:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:42.101542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:42.196428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:42.213870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07c321-1496-4ee2-8d6b-43c098c2f25d None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:42.256160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:42.256792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:42.257070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:42.257344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:42.331140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:42.332640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:42.432257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:42.443376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 628/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Mon Sep 26 05:19:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:19:42.452952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:42.523670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:42.563859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6164fc-6bc0-4267-86b7-a86fe0854716 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:42.601882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:42.602508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:42.602787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:42.603055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:42.614771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:42.616249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:19:42.632345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:42.633455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:19:42.635291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:19:42.635291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:19:42.635291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:42.635291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 655/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:42.640416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:42.747418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2edad7-408a-43fd-ae62-97b0449ae815 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:42.782775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:42.783363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:42.783632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:42.783895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:42.784525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:42.784823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:42.786179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:42.797926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 629/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Mon Sep 26 05:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:42.803881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:42.926406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bd615-bf6c-4af7-9183-983b58a24647 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:42.948295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:42.969275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:42.969900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:42.970179 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:42.970444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:42.977326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:42.978766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:19:42.990419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:42.991598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: ERROR keystone.server.flask.application Sep 26 05:19:42.992838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 656/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Mon Sep 26 05:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:42.998663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:43.052445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:43.104525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c912e1c-e90f-4fda-b836-214f534b6888 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:43.150079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786aa03-d194-41be-8e7d-3a9460139eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:43.151000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786aa03-d194-41be-8e7d-3a9460139eeb None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:43.151433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786aa03-d194-41be-8e7d-3a9460139eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:43.151874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786aa03-d194-41be-8e7d-3a9460139eeb None admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:43.152866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786aa03-d194-41be-8e7d-3a9460139eeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:43.153173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786aa03-d194-41be-8e7d-3a9460139eeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:43.154607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786aa03-d194-41be-8e7d-3a9460139eeb None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:43.168328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 630/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Mon Sep 26 05:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:43.174832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:43.282842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5a5d8-11ad-4c36-8c4e-ac0732dd9de4 None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:43.318103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ba36e-98a7-40dd-96dc-d06354220985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:43.318698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba36e-98a7-40dd-96dc-d06354220985 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:43.318973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba36e-98a7-40dd-96dc-d06354220985 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:43.319240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ba36e-98a7-40dd-96dc-d06354220985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:43.319988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba36e-98a7-40dd-96dc-d06354220985 None admin] RBAC: Adding query filter params (role.id=2a7a9fd3de9a46c0a085d538e1a486bb, scope.project.id=6db4696e870e4131aa66e3a7908c8928, user.id=236e8947ce084c019d269170624fa35b) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:43.320290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba36e-98a7-40dd-96dc-d06354220985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:43.321708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ba36e-98a7-40dd-96dc-d06354220985 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:43.327590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 657/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Mon Sep 26 05:19:43 2022] GET /identity/v3/role_assignments?user.id=236e8947ce084c019d269170624fa35b&scope.project.id=6db4696e870e4131aa66e3a7908c8928&role.id=2a7a9fd3de9a46c0a085d538e1a486bb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:45.458156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df46fc-dd9d-46e5-b766-ef56ca8c783d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:45.459099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df46fc-dd9d-46e5-b766-ef56ca8c783d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:45.459099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df46fc-dd9d-46e5-b766-ef56ca8c783d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:45.461260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 631/1288] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:45.467591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681dc7a-bc53-49a1-bdfd-70aa14075489 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:45.468307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681dc7a-bc53-49a1-bdfd-70aa14075489 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:45.468431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681dc7a-bc53-49a1-bdfd-70aa14075489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:45.497932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e681dc7a-bc53-49a1-bdfd-70aa14075489 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:45.499167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e681dc7a-bc53-49a1-bdfd-70aa14075489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:45.529809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:45.577556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 658/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:45.844258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df46fc-dd9d-46e5-b766-ef56ca8c783d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:45.967193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df46fc-dd9d-46e5-b766-ef56ca8c783d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:45.978290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:46.006114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:46.006770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:46.007070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:46.007257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:46.007876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:46.009243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:46.018754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:46.020150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:46.021191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 632/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:19:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:46.026066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681dc7a-bc53-49a1-bdfd-70aa14075489 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:46.136688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681dc7a-bc53-49a1-bdfd-70aa14075489 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:46.174371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fdbd3d-8636-403c-9df6-7ebb7d7f022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:46.174968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdbd3d-8636-403c-9df6-7ebb7d7f022b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:46.175241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdbd3d-8636-403c-9df6-7ebb7d7f022b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:46.175508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdbd3d-8636-403c-9df6-7ebb7d7f022b None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:46.176162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdbd3d-8636-403c-9df6-7ebb7d7f022b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:46.176458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdbd3d-8636-403c-9df6-7ebb7d7f022b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:46.177818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fdbd3d-8636-403c-9df6-7ebb7d7f022b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:46.184278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 659/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 05:19:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:46.190732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:46.306563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc951d-9c53-4282-b850-9945be5a1058 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:46.345286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad811c-ca67-4fb9-8756-ff2528842bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:46.345889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad811c-ca67-4fb9-8756-ff2528842bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:46.346169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad811c-ca67-4fb9-8756-ff2528842bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:46.346437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad811c-ca67-4fb9-8756-ff2528842bc0 None admin] PATH_INFO: `/v3/services` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:46.347065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad811c-ca67-4fb9-8756-ff2528842bc0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:46.347368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad811c-ca67-4fb9-8756-ff2528842bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:46.348782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad811c-ca67-4fb9-8756-ff2528842bc0 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:46.353525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 633/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 05:19:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:48.472820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894e83-e227-47ec-bc26-3b135fab9ee3 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:48.473720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894e83-e227-47ec-bc26-3b135fab9ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:48.473720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5894e83-e227-47ec-bc26-3b135fab9ee3 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:48.475936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 660/1293] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:48.482386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d98bb-d211-479c-9320-6a34c6de6e8b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:48.482820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d98bb-d211-479c-9320-6a34c6de6e8b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:48.482929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d98bb-d211-479c-9320-6a34c6de6e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:48.506787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-379d98bb-d211-479c-9320-6a34c6de6e8b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:48.508010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-379d98bb-d211-479c-9320-6a34c6de6e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:48.543374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:48.585184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 634/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:48.849624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5894e83-e227-47ec-bc26-3b135fab9ee3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:48.891150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:48.968518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5894e83-e227-47ec-bc26-3b135fab9ee3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:49.003687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f33455-aafc-4bea-9441-c32a4c832e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:49.004304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33455-aafc-4bea-9441-c32a4c832e67 None admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:49.004575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33455-aafc-4bea-9441-c32a4c832e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:49.004842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f33455-aafc-4bea-9441-c32a4c832e67 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:49.005490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f33455-aafc-4bea-9441-c32a4c832e67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:49.006862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f33455-aafc-4bea-9441-c32a4c832e67 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:49.023948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 661/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Mon Sep 26 05:19:48 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:19:51.130306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa90b-a17d-41f3-b61b-924e744b2df1 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:51.130919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa90b-a17d-41f3-b61b-924e744b2df1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:51.130919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa90b-a17d-41f3-b61b-924e744b2df1 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:51.132196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 635/1296] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:51.138615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01be3-c9c8-448b-aa01-08299cae2b1b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:51.139335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01be3-c9c8-448b-aa01-08299cae2b1b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:51.139477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f01be3-c9c8-448b-aa01-08299cae2b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:51.163816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f4f01be3-c9c8-448b-aa01-08299cae2b1b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:51.165005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f4f01be3-c9c8-448b-aa01-08299cae2b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:51.242991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 662/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:51.505003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa90b-a17d-41f3-b61b-924e744b2df1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:51.614557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa90b-a17d-41f3-b61b-924e744b2df1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:51.650424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:51.651045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:51.651287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:51.651595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:51.652246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:51.653606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:51.662536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:51.663688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:51.664726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:51.667730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 636/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:19:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:51.670131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f01be3-c9c8-448b-aa01-08299cae2b1b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:51.691301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:51.778140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f01be3-c9c8-448b-aa01-08299cae2b1b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:51.813161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:51.813757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:51.814037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:51.814310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:51.814937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] RBAC: Adding query filter params (name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:51.815238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:51.816642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:51.821691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 663/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 05:19:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:51.831354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:51.865729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:51.945306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80bde3-d66f-4054-9e95-4c3d6cff6a41 None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:51.982158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abc4e3-fcb7-458d-a648-907d16ba4bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:51.982767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abc4e3-fcb7-458d-a648-907d16ba4bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:51.983045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abc4e3-fcb7-458d-a648-907d16ba4bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:51.983321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abc4e3-fcb7-458d-a648-907d16ba4bd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:51.984061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abc4e3-fcb7-458d-a648-907d16ba4bd9 None admin] RBAC: Adding query filter params (interface=public, service_id=8dfff448438f422ba068dbd4d4299bee, region_id=RegionOne) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:51.984367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abc4e3-fcb7-458d-a648-907d16ba4bd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:51.985749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abc4e3-fcb7-458d-a648-907d16ba4bd9 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:51.991138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 637/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Mon Sep 26 05:19:51 2022] GET /identity/v3/endpoints?service_id=8dfff448438f422ba068dbd4d4299bee&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:51.997286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:52.096541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:52.118368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b40fae-f723-4bc5-bf55-dd284a29e5de None admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:52.154784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e042b4e-1545-483b-b0a3-ebe13f783ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:52.155391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042b4e-1545-483b-b0a3-ebe13f783ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:52.155662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042b4e-1545-483b-b0a3-ebe13f783ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:52.155928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e042b4e-1545-483b-b0a3-ebe13f783ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:52.156529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e042b4e-1545-483b-b0a3-ebe13f783ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:52.157873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e042b4e-1545-483b-b0a3-ebe13f783ca4 None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:52.164772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 664/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Mon Sep 26 05:19:51 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:19:54.287323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670add9-9fb1-4940-9266-bdf1d4f95b4c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:54.288120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670add9-9fb1-4940-9266-bdf1d4f95b4c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:54.288267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670add9-9fb1-4940-9266-bdf1d4f95b4c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:54.290342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 638/1302] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:19:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:19:54.299058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2693de2-7113-4350-bbd3-65970519d8e6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:54.299527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2693de2-7113-4350-bbd3-65970519d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:54.299704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2693de2-7113-4350-bbd3-65970519d8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:54.322168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f2693de2-7113-4350-bbd3-65970519d8e6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:19:54.323367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f2693de2-7113-4350-bbd3-65970519d8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:19:54.391707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 665/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:19:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:19:54.659876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670add9-9fb1-4940-9266-bdf1d4f95b4c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:54.761500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:54.769289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670add9-9fb1-4940-9266-bdf1d4f95b4c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:54.806464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:54.807077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:54.807351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:54.807653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:54.808342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:54.810073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:19:54.819276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:19:54.820444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application with Lock( Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: ERROR keystone.server.flask.application Sep 26 05:19:54.821330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 639/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Mon Sep 26 05:19:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:19:54.826858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2693de2-7113-4350-bbd3-65970519d8e6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:54.906394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:19:54.938443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2693de2-7113-4350-bbd3-65970519d8e6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:54.975857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ec2f9-0113-4825-b3fd-10f4e94ab09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:54.976455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ec2f9-0113-4825-b3fd-10f4e94ab09b None admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:54.976728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ec2f9-0113-4825-b3fd-10f4e94ab09b None admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:54.976992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ec2f9-0113-4825-b3fd-10f4e94ab09b None admin] PATH_INFO: `/v3/services` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:54.977615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ec2f9-0113-4825-b3fd-10f4e94ab09b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:19:54.977908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ec2f9-0113-4825-b3fd-10f4e94ab09b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:54.979291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ec2f9-0113-4825-b3fd-10f4e94ab09b None admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:54.984615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 666/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Mon Sep 26 05:19:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:19:54.993616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:19:55.103330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545df91-85cd-4442-9bba-f056f81bf8fd None admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:19:55.139438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314afc7f-225a-4177-90f5-6b777f6f5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:19:55.140065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afc7f-225a-4177-90f5-6b777f6f5256 None admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:19:55.140341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afc7f-225a-4177-90f5-6b777f6f5256 None admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:19:55.140615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314afc7f-225a-4177-90f5-6b777f6f5256 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:19:55.141278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314afc7f-225a-4177-90f5-6b777f6f5256 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:19:55.142655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314afc7f-225a-4177-90f5-6b777f6f5256 None admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:19:55.167425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 640/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:19:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:20:04.981554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=30 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:20:05.162736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:20:59.487638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528b1f-e5c2-42a7-8ce7-1b86bbb3ddda None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:20:59.488220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528b1f-e5c2-42a7-8ce7-1b86bbb3ddda None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:20:59.488220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528b1f-e5c2-42a7-8ce7-1b86bbb3ddda None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:20:59.495037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea835-35d7-473f-be16-b79c07772273 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:20:59.495432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea835-35d7-473f-be16-b79c07772273 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:20:59.495683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea835-35d7-473f-be16-b79c07772273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:20:59.500667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 667/1307] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:20:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:20:59.665296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d3aea835-35d7-473f-be16-b79c07772273 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:20:59.666384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d3aea835-35d7-473f-be16-b79c07772273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:20:59.844498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 641/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:21:00.144550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449bfc-8526-419d-9bd1-40af238901fe None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:00.144834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449bfc-8526-419d-9bd1-40af238901fe None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:00.145396 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449bfc-8526-419d-9bd1-40af238901fe None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:00.146977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 668/1309] 10.222.0.18 () {54 vars in 964 bytes} [Mon Sep 26 05:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:00.153410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba949-7404-42e5-aa18-dcefc67c85a4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:00.153976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba949-7404-42e5-aa18-dcefc67c85a4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:00.154328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba949-7404-42e5-aa18-dcefc67c85a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:00.238149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7adba949-7404-42e5-aa18-dcefc67c85a4 None None] MFA Rules not processed for user `de2913a65aac4fda97bc92dbf15d3316`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:00.239371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7adba949-7404-42e5-aa18-dcefc67c85a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:00.262211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:00.329813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 642/1310] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Sep 26 05:21:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:00.339700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449bfc-8526-419d-9bd1-40af238901fe None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:00.341526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-94449bfc-8526-419d-9bd1-40af238901fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:00.475576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449bfc-8526-419d-9bd1-40af238901fe None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:00.565564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f755d5c-e292-48b8-87ea-5bcc0422c5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:00.566394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f755d5c-e292-48b8-87ea-5bcc0422c5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:00.566624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f755d5c-e292-48b8-87ea-5bcc0422c5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:00.566898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f755d5c-e292-48b8-87ea-5bcc0422c5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:00.568552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8f755d5c-e292-48b8-87ea-5bcc0422c5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:00.628289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:00.691221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f755d5c-e292-48b8-87ea-5bcc0422c5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:00.692724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f755d5c-e292-48b8-87ea-5bcc0422c5d4 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:00.712645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 669/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:03.142214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d593f2-705d-4146-aded-fd669616e97a None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:03.142759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d593f2-705d-4146-aded-fd669616e97a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:03.142759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d593f2-705d-4146-aded-fd669616e97a None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:03.144316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 643/1312] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:03.149807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec942a-5d28-4602-be58-0839bd63913a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:03.150287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec942a-5d28-4602-be58-0839bd63913a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:03.150402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec942a-5d28-4602-be58-0839bd63913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:03.237539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-15ec942a-5d28-4602-be58-0839bd63913a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:03.238746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-15ec942a-5d28-4602-be58-0839bd63913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:03.342403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 670/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:21:03.640503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbdddc-dfdb-433b-a6a0-ba444267b00d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:03.640827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbdddc-dfdb-433b-a6a0-ba444267b00d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:03.641100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbdddc-dfdb-433b-a6a0-ba444267b00d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:03.642483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 644/1314] 10.222.0.18 () {54 vars in 964 bytes} [Mon Sep 26 05:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:03.648590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ab97-bb6a-44f0-80f0-038891a470a1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:03.648880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ab97-bb6a-44f0-80f0-038891a470a1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:03.649156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6ab97-bb6a-44f0-80f0-038891a470a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:03.661804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:03.738907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ece6ab97-bb6a-44f0-80f0-038891a470a1 None None] MFA Rules not processed for user `de2913a65aac4fda97bc92dbf15d3316`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:03.740185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ece6ab97-bb6a-44f0-80f0-038891a470a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:03.826170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 671/1315] 10.222.0.18 () {58 vars in 1061 bytes} [Mon Sep 26 05:21:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:03.835637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbdddc-dfdb-433b-a6a0-ba444267b00d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:03.837273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6dbbdddc-dfdb-433b-a6a0-ba444267b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:03.953165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbdddc-dfdb-433b-a6a0-ba444267b00d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:04.031423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:04.034406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bae72a6-69a4-428f-b41c-7de20e4fb0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:04.035028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae72a6-69a4-428f-b41c-7de20e4fb0eb service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:04.035376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae72a6-69a4-428f-b41c-7de20e4fb0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:04.035671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bae72a6-69a4-428f-b41c-7de20e4fb0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:04.038201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6bae72a6-69a4-428f-b41c-7de20e4fb0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:04.150199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae72a6-69a4-428f-b41c-7de20e4fb0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:04.151863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bae72a6-69a4-428f-b41c-7de20e4fb0eb service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:04.170245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 645/1316] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:06.845568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49e5-badb-4b6a-8086-7ae35119f227 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:06.846146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49e5-badb-4b6a-8086-7ae35119f227 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:06.846146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad49e5-badb-4b6a-8086-7ae35119f227 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:06.847478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 672/1317] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:06.852988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4795fd-a0d1-42c7-b244-61b5a8f7a0ce None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:06.853435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4795fd-a0d1-42c7-b244-61b5a8f7a0ce None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:06.853585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4795fd-a0d1-42c7-b244-61b5a8f7a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:06.923663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2d4795fd-a0d1-42c7-b244-61b5a8f7a0ce None None] MFA Rules not processed for user `c50a2ac67d964f06a3bbd3d9bb873155`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:06.924868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2d4795fd-a0d1-42c7-b244-61b5a8f7a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:06.990599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:07.037812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 646/1318] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:07.321952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad49e5-badb-4b6a-8086-7ae35119f227 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:07.323538 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-28ad49e5-badb-4b6a-8086-7ae35119f227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:07.431776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad49e5-badb-4b6a-8086-7ae35119f227 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:07.435062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:07.510311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd59c1-ef52-4a5f-8902-126ec6d5bfe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:07.510915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd59c1-ef52-4a5f-8902-126ec6d5bfe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:07.511197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd59c1-ef52-4a5f-8902-126ec6d5bfe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:07.511457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd59c1-ef52-4a5f-8902-126ec6d5bfe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:07.513085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8bbd59c1-ef52-4a5f-8902-126ec6d5bfe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:07.628757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd59c1-ef52-4a5f-8902-126ec6d5bfe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:07.630192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd59c1-ef52-4a5f-8902-126ec6d5bfe8 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:07.648286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 673/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:21:10.378717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86bd5-db0e-4179-817a-0f6b0cdf78b9 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:10.379674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86bd5-db0e-4179-817a-0f6b0cdf78b9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:10.379674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86bd5-db0e-4179-817a-0f6b0cdf78b9 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:10.381764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 647/1320] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:10.389541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be2b1-4c8a-443f-b873-b6f50b958aef None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:10.389995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be2b1-4c8a-443f-b873-b6f50b958aef None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:10.390100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626be2b1-4c8a-443f-b873-b6f50b958aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:10.441389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:10.468569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-626be2b1-4c8a-443f-b873-b6f50b958aef None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:10.469783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-626be2b1-4c8a-443f-b873-b6f50b958aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:10.575703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 674/1321] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:10.861181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c86bd5-db0e-4179-817a-0f6b0cdf78b9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:10.862726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-80c86bd5-db0e-4179-817a-0f6b0cdf78b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:10.974798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c86bd5-db0e-4179-817a-0f6b0cdf78b9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:11.056152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530aa665-34aa-4270-a96c-57d64820dd27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:11.056904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa665-34aa-4270-a96c-57d64820dd27 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:11.057270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa665-34aa-4270-a96c-57d64820dd27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:11.057538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aa665-34aa-4270-a96c-57d64820dd27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:11.059471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-530aa665-34aa-4270-a96c-57d64820dd27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:11.066736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:11.177382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aa665-34aa-4270-a96c-57d64820dd27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:11.178829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530aa665-34aa-4270-a96c-57d64820dd27 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:11.197927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 648/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:14.034546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498b2f-d18a-4443-be30-dd7bb7a2d7df None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:14.035123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498b2f-d18a-4443-be30-dd7bb7a2d7df None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:14.035123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498b2f-d18a-4443-be30-dd7bb7a2d7df None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:14.036490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 675/1323] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:14.042255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c999c-b8be-4bfc-afa0-d1c5587b3b0c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:14.042728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c999c-b8be-4bfc-afa0-d1c5587b3b0c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:14.042893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c999c-b8be-4bfc-afa0-d1c5587b3b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:14.121845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-493c999c-b8be-4bfc-afa0-d1c5587b3b0c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:14.123102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-493c999c-b8be-4bfc-afa0-d1c5587b3b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:14.190431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:14.235076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 649/1324] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:14.514334 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03498b2f-d18a-4443-be30-dd7bb7a2d7df None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:14.515938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-03498b2f-d18a-4443-be30-dd7bb7a2d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:14.630643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03498b2f-d18a-4443-be30-dd7bb7a2d7df None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:14.643764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:14.706743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35fba3-5cd3-466e-8441-7529f33d0c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:14.707375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35fba3-5cd3-466e-8441-7529f33d0c09 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:14.707693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35fba3-5cd3-466e-8441-7529f33d0c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:14.707961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35fba3-5cd3-466e-8441-7529f33d0c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:14.709574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2a35fba3-5cd3-466e-8441-7529f33d0c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:14.822209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35fba3-5cd3-466e-8441-7529f33d0c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:14.823859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a35fba3-5cd3-466e-8441-7529f33d0c09 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:14.842687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 676/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:17.034709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430bf9d-2199-47f2-baf5-08d90edde6ec None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:17.035350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430bf9d-2199-47f2-baf5-08d90edde6ec None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:17.035350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430bf9d-2199-47f2-baf5-08d90edde6ec None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:17.036609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 650/1326] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:17.042185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e871-e46d-4426-aa4e-4d3b9e9b7e00 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:17.042669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e871-e46d-4426-aa4e-4d3b9e9b7e00 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:17.042757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180e871-e46d-4426-aa4e-4d3b9e9b7e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:17.093598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:17.112824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8180e871-e46d-4426-aa4e-4d3b9e9b7e00 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:17.114090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8180e871-e46d-4426-aa4e-4d3b9e9b7e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:17.226075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 677/1327] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:17.512122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430bf9d-2199-47f2-baf5-08d90edde6ec None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:17.513757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f430bf9d-2199-47f2-baf5-08d90edde6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:17.623267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430bf9d-2199-47f2-baf5-08d90edde6ec None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:17.706307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb48fc-1249-40df-936c-5412742ef6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:17.706917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb48fc-1249-40df-936c-5412742ef6ca service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:17.707188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb48fc-1249-40df-936c-5412742ef6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:17.707456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb48fc-1249-40df-936c-5412742ef6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:17.709453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-84cb48fc-1249-40df-936c-5412742ef6ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:17.728912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:17.826765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb48fc-1249-40df-936c-5412742ef6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:17.828167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb48fc-1249-40df-936c-5412742ef6ca service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:17.846572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 651/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:20.107877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049617dd-53b5-4e81-87a7-0beb85aa708d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:20.108442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049617dd-53b5-4e81-87a7-0beb85aa708d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:20.108553 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049617dd-53b5-4e81-87a7-0beb85aa708d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:20.109905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 678/1329] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:20.115715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297f471-ee95-4331-b737-57f8f79e7ba3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:20.116180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297f471-ee95-4331-b737-57f8f79e7ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:20.116180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297f471-ee95-4331-b737-57f8f79e7ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:20.193271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5297f471-ee95-4331-b737-57f8f79e7ba3 None None] MFA Rules not processed for user `c50a2ac67d964f06a3bbd3d9bb873155`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:20.194497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5297f471-ee95-4331-b737-57f8f79e7ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:20.263486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:20.299832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 652/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:20.579076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049617dd-53b5-4e81-87a7-0beb85aa708d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:20.580666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-049617dd-53b5-4e81-87a7-0beb85aa708d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:20.697968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049617dd-53b5-4e81-87a7-0beb85aa708d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:20.721631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:20.778369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cb301-56f8-4867-aa18-36322a570977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:20.778892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb301-56f8-4867-aa18-36322a570977 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:20.779168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb301-56f8-4867-aa18-36322a570977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:20.779436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cb301-56f8-4867-aa18-36322a570977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:20.781070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-382cb301-56f8-4867-aa18-36322a570977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:20.894797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cb301-56f8-4867-aa18-36322a570977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:20.896265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cb301-56f8-4867-aa18-36322a570977 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:20.915355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 679/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:23.487493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11834272-33fb-47d5-9584-cbbf9f76ce5c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:23.488153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11834272-33fb-47d5-9584-cbbf9f76ce5c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:23.488153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11834272-33fb-47d5-9584-cbbf9f76ce5c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:23.489392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 653/1332] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:23.497033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a63f-7d40-4d28-a8cd-e7e1c0ab4994 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:23.497493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a63f-7d40-4d28-a8cd-e7e1c0ab4994 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:23.497600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23a63f-7d40-4d28-a8cd-e7e1c0ab4994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:23.582834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:23.585946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8c23a63f-7d40-4d28-a8cd-e7e1c0ab4994 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:23.587803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8c23a63f-7d40-4d28-a8cd-e7e1c0ab4994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:23.688994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 680/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:23.980782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11834272-33fb-47d5-9584-cbbf9f76ce5c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:23.982347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-11834272-33fb-47d5-9584-cbbf9f76ce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:24.110326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11834272-33fb-47d5-9584-cbbf9f76ce5c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:24.189129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aac9c6-a49c-455b-8423-5c51553a375b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:24.189732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aac9c6-a49c-455b-8423-5c51553a375b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:24.190001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aac9c6-a49c-455b-8423-5c51553a375b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:24.190262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aac9c6-a49c-455b-8423-5c51553a375b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:24.191869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-71aac9c6-a49c-455b-8423-5c51553a375b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:24.219410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:24.319821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aac9c6-a49c-455b-8423-5c51553a375b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:24.321305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aac9c6-a49c-455b-8423-5c51553a375b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:24.340931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 654/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:26.500884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef74a09-abbc-4b7a-adba-ae7427c107d2 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:26.501473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef74a09-abbc-4b7a-adba-ae7427c107d2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:26.501473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef74a09-abbc-4b7a-adba-ae7427c107d2 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:26.503343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 681/1335] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:26.508872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb389f-6e20-4e31-91ec-7c8fa79a6ca2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:26.509376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb389f-6e20-4e31-91ec-7c8fa79a6ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:26.509723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb389f-6e20-4e31-91ec-7c8fa79a6ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:26.581543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-efdb389f-6e20-4e31-91ec-7c8fa79a6ca2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:26.582679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-efdb389f-6e20-4e31-91ec-7c8fa79a6ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:26.660758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:26.683918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 655/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:26.964199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef74a09-abbc-4b7a-adba-ae7427c107d2 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:26.966706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7ef74a09-abbc-4b7a-adba-ae7427c107d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:27.079221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef74a09-abbc-4b7a-adba-ae7427c107d2 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:27.113549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:27.169914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2343dde-733b-4370-a706-db57927b37a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:27.170541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2343dde-733b-4370-a706-db57927b37a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:27.170830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2343dde-733b-4370-a706-db57927b37a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:27.171088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2343dde-733b-4370-a706-db57927b37a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:27.172738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e2343dde-733b-4370-a706-db57927b37a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:27.290747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2343dde-733b-4370-a706-db57927b37a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:27.292290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2343dde-733b-4370-a706-db57927b37a2 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:27.311202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 682/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:29.938473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59359c0-1dd1-477d-be73-2973669e4821 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:29.939029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59359c0-1dd1-477d-be73-2973669e4821 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:29.939029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59359c0-1dd1-477d-be73-2973669e4821 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:29.940407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 656/1338] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:29.946602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23edd-5c0b-488a-9355-e572bdc066b8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:29.947350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23edd-5c0b-488a-9355-e572bdc066b8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:29.947833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb23edd-5c0b-488a-9355-e572bdc066b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:30.028622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fdb23edd-5c0b-488a-9355-e572bdc066b8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:30.029745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fdb23edd-5c0b-488a-9355-e572bdc066b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:30.038444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:30.136110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 683/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:30.424165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59359c0-1dd1-477d-be73-2973669e4821 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:30.426664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c59359c0-1dd1-477d-be73-2973669e4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:30.544191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59359c0-1dd1-477d-be73-2973669e4821 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:30.631944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315532fb-2d35-4613-a91b-917c6dfefe7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:30.632549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315532fb-2d35-4613-a91b-917c6dfefe7b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:30.632847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315532fb-2d35-4613-a91b-917c6dfefe7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:30.633070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315532fb-2d35-4613-a91b-917c6dfefe7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:30.634747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-315532fb-2d35-4613-a91b-917c6dfefe7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:30.671458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:30.763174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315532fb-2d35-4613-a91b-917c6dfefe7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:30.764659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315532fb-2d35-4613-a91b-917c6dfefe7b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:30.783773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 657/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:35.022431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a361e-e6b7-4492-b141-530c22ef5226 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:35.022984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a361e-e6b7-4492-b141-530c22ef5226 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:35.022984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a361e-e6b7-4492-b141-530c22ef5226 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:35.024573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 684/1341] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:35.030280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16f65-0d45-4e52-a09e-81f97cf3a5db None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:35.030749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16f65-0d45-4e52-a09e-81f97cf3a5db None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:35.030832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16f65-0d45-4e52-a09e-81f97cf3a5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:35.106836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0fb16f65-0d45-4e52-a09e-81f97cf3a5db None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:35.108485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0fb16f65-0d45-4e52-a09e-81f97cf3a5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:35.196353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:35.211585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 658/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:35.494933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a361e-e6b7-4492-b141-530c22ef5226 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:35.496574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e97a361e-e6b7-4492-b141-530c22ef5226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:35.601750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a361e-e6b7-4492-b141-530c22ef5226 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:35.640539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:35.677930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deded97f-1468-4c63-860e-75d9da17bb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:35.678548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded97f-1468-4c63-860e-75d9da17bb89 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:35.678823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded97f-1468-4c63-860e-75d9da17bb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:35.679094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deded97f-1468-4c63-860e-75d9da17bb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:35.680752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-deded97f-1468-4c63-860e-75d9da17bb89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:35.794439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deded97f-1468-4c63-860e-75d9da17bb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:35.795871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deded97f-1468-4c63-860e-75d9da17bb89 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:35.815137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 685/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:38.594333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc093437-282f-45a0-8418-1618c0e1508e None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:38.594895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc093437-282f-45a0-8418-1618c0e1508e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:38.594895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc093437-282f-45a0-8418-1618c0e1508e None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:38.596151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 659/1344] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:38.601646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d93f3-774e-49da-a9d2-0e04d9a4cb1c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:38.602069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d93f3-774e-49da-a9d2-0e04d9a4cb1c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:38.602208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d93f3-774e-49da-a9d2-0e04d9a4cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:38.669034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4a5d93f3-774e-49da-a9d2-0e04d9a4cb1c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:38.670250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4a5d93f3-774e-49da-a9d2-0e04d9a4cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:38.689514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:38.771160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 686/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:39.050125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc093437-282f-45a0-8418-1618c0e1508e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:39.052028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fc093437-282f-45a0-8418-1618c0e1508e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:39.167367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc093437-282f-45a0-8418-1618c0e1508e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:39.246488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826369e-ef5f-4674-a78d-5d05c11a099b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:39.247096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826369e-ef5f-4674-a78d-5d05c11a099b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:39.247367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826369e-ef5f-4674-a78d-5d05c11a099b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:39.247667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826369e-ef5f-4674-a78d-5d05c11a099b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:39.249261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0826369e-ef5f-4674-a78d-5d05c11a099b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:39.293979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:39.370291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826369e-ef5f-4674-a78d-5d05c11a099b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:39.371798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826369e-ef5f-4674-a78d-5d05c11a099b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:39.390804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 660/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:43.514467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e26c-2349-41b4-860e-2aa2ec89c111 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:43.514965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e26c-2349-41b4-860e-2aa2ec89c111 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:43.515071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447e26c-2349-41b4-860e-2aa2ec89c111 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:43.516447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 687/1347] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:43.522099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a0f6-3d50-4de1-975e-014d13ce022a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:43.522566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a0f6-3d50-4de1-975e-014d13ce022a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:43.522668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42a0f6-3d50-4de1-975e-014d13ce022a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:43.595795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ce42a0f6-3d50-4de1-975e-014d13ce022a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:43.596954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ce42a0f6-3d50-4de1-975e-014d13ce022a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:43.698533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:43.700863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 661/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:43.982717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447e26c-2349-41b4-860e-2aa2ec89c111 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:43.985272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1447e26c-2349-41b4-860e-2aa2ec89c111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:44.100878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447e26c-2349-41b4-860e-2aa2ec89c111 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:21:44.160189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:44.188448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c81ff-7944-4195-8653-aa68c7636d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:21:44.189067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c81ff-7944-4195-8653-aa68c7636d54 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:44.189305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c81ff-7944-4195-8653-aa68c7636d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:44.189604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c81ff-7944-4195-8653-aa68c7636d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:44.191201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8d7c81ff-7944-4195-8653-aa68c7636d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:44.307922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c81ff-7944-4195-8653-aa68c7636d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:21:44.309370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c81ff-7944-4195-8653-aa68c7636d54 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:21:44.330530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 688/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:21:49.228642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbeaab-e337-4f3d-9aa9-c8e6f49f8a69 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:49.229511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbeaab-e337-4f3d-9aa9-c8e6f49f8a69 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:49.230006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbeaab-e337-4f3d-9aa9-c8e6f49f8a69 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:49.232915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 662/1350] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:21:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:49.238546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c24d-4bf0-45f0-b07e-86740379710f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:49.239010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c24d-4bf0-45f0-b07e-86740379710f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:49.239010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174c24d-4bf0-45f0-b07e-86740379710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:49.367951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c174c24d-4bf0-45f0-b07e-86740379710f None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:49.369748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c174c24d-4bf0-45f0-b07e-86740379710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:49.390614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:49.535410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 689/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:21:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:53.805073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb27a1-e7d0-493d-bdce-76740b00498e None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:53.805654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb27a1-e7d0-493d-bdce-76740b00498e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:53.805654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb27a1-e7d0-493d-bdce-76740b00498e None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:53.807789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 663/1352] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:53.812875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0790a06-b008-45f6-a003-2107d819f805 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:53.813300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0790a06-b008-45f6-a003-2107d819f805 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:53.813455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0790a06-b008-45f6-a003-2107d819f805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:53.894232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b0790a06-b008-45f6-a003-2107d819f805 None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:53.895454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b0790a06-b008-45f6-a003-2107d819f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:53.976704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:54.018086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 690/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:21:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:55.269792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ebc41-5909-4198-a88b-a0c8a99f6cd5 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:55.270349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ebc41-5909-4198-a88b-a0c8a99f6cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:55.270349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ebc41-5909-4198-a88b-a0c8a99f6cd5 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:55.271970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 664/1354] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:21:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:55.276915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b61c3-3fbd-4d79-a337-01cce8cd9194 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:55.277360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b61c3-3fbd-4d79-a337-01cce8cd9194 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:55.277454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b61c3-3fbd-4d79-a337-01cce8cd9194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:55.361666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-050b61c3-3fbd-4d79-a337-01cce8cd9194 None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:55.363031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-050b61c3-3fbd-4d79-a337-01cce8cd9194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:55.471903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 691/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:21:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:21:59.067091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83136-0fe2-471a-908e-86fa7076355b None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:59.067816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83136-0fe2-471a-908e-86fa7076355b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:59.067816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c83136-0fe2-471a-908e-86fa7076355b None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:59.068894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 665/1356] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:21:59.075199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36139678-0e6a-4334-97cc-9f81e9af2092 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:59.076412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36139678-0e6a-4334-97cc-9f81e9af2092 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:59.076897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36139678-0e6a-4334-97cc-9f81e9af2092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:59.117030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:59.154023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-36139678-0e6a-4334-97cc-9f81e9af2092 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:59.155250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-36139678-0e6a-4334-97cc-9f81e9af2092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:59.260139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 692/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:59.560946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970720-2706-46c5-89ef-fc914f642ac5 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:59.561224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970720-2706-46c5-89ef-fc914f642ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:59.561676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26970720-2706-46c5-89ef-fc914f642ac5 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:59.563152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 666/1358] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 05:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:21:59.583178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ec596-31cb-40f3-9880-4393980931ac None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:21:59.583735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ec596-31cb-40f3-9880-4393980931ac None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:21:59.585633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ec596-31cb-40f3-9880-4393980931ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:21:59.666902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6f3ec596-31cb-40f3-9880-4393980931ac None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:21:59.668293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6f3ec596-31cb-40f3-9880-4393980931ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:59.720532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:21:59.814058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 693/1359] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 05:21:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:21:59.822127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970720-2706-46c5-89ef-fc914f642ac5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:21:59.823660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-26970720-2706-46c5-89ef-fc914f642ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:21:59.981147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26970720-2706-46c5-89ef-fc914f642ac5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:00.071922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:00.114523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d210a7-48b2-4188-a5e4-02d6a9bc8469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:00.115226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d210a7-48b2-4188-a5e4-02d6a9bc8469 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:00.115578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d210a7-48b2-4188-a5e4-02d6a9bc8469 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:00.115915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d210a7-48b2-4188-a5e4-02d6a9bc8469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:00.117542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-14d210a7-48b2-4188-a5e4-02d6a9bc8469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:00.221060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d210a7-48b2-4188-a5e4-02d6a9bc8469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:00.222857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d210a7-48b2-4188-a5e4-02d6a9bc8469 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:00.242341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 667/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:02.611651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb2ac-bcee-4c8f-a006-781a69942084 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:02.611651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb2ac-bcee-4c8f-a006-781a69942084 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:02.611651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fb2ac-bcee-4c8f-a006-781a69942084 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:02.613106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 694/1361] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:02.618823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5e54-62ad-4291-be31-5e0aec218d8a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:02.618823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5e54-62ad-4291-be31-5e0aec218d8a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:02.619656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc5e54-62ad-4291-be31-5e0aec218d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:02.686971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6cdc5e54-62ad-4291-be31-5e0aec218d8a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:02.688186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6cdc5e54-62ad-4291-be31-5e0aec218d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:02.726892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:02.790067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 668/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:03.074349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fb2ac-bcee-4c8f-a006-781a69942084 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:03.075693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9d6fb2ac-bcee-4c8f-a006-781a69942084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:03.254395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fb2ac-bcee-4c8f-a006-781a69942084 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:03.269155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:03.401063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e9ede-886d-43e0-8172-dae589827e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:03.401063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9ede-886d-43e0-8172-dae589827e11 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:03.402094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9ede-886d-43e0-8172-dae589827e11 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:03.402094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9ede-886d-43e0-8172-dae589827e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:03.403782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a08e9ede-886d-43e0-8172-dae589827e11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:03.498279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e9ede-886d-43e0-8172-dae589827e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:03.499940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e9ede-886d-43e0-8172-dae589827e11 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:03.518317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 695/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:06.012676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008a94-008f-4f07-a1cf-baa4253bfbb6 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:06.013205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008a94-008f-4f07-a1cf-baa4253bfbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:06.013205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1008a94-008f-4f07-a1cf-baa4253bfbb6 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:06.014739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 669/1364] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:06.019974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc6d9-9c20-44ca-a1dc-af627d5c4db1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:06.020416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc6d9-9c20-44ca-a1dc-af627d5c4db1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:06.020611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbc6d9-9c20-44ca-a1dc-af627d5c4db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:06.037686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:06.095559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e2dbc6d9-9c20-44ca-a1dc-af627d5c4db1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:06.096824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e2dbc6d9-9c20-44ca-a1dc-af627d5c4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:06.200984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 696/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:06.486620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373d432-da0f-4646-9667-7daf5b788ddb None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:06.487043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373d432-da0f-4646-9667-7daf5b788ddb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:06.487445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373d432-da0f-4646-9667-7daf5b788ddb None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:06.488988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 670/1366] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 05:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:06.495456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63ccf-aff7-427f-8cb5-b7ab13cafd9c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:06.495872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63ccf-aff7-427f-8cb5-b7ab13cafd9c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:06.496250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae63ccf-aff7-427f-8cb5-b7ab13cafd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:06.577443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5ae63ccf-aff7-427f-8cb5-b7ab13cafd9c None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:06.578735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5ae63ccf-aff7-427f-8cb5-b7ab13cafd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:06.616976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:06.703442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 697/1367] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 05:22:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:06.711329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373d432-da0f-4646-9667-7daf5b788ddb None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:06.713669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3373d432-da0f-4646-9667-7daf5b788ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:06.874594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373d432-da0f-4646-9667-7daf5b788ddb None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:06.895949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:07.000623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fcd366-ca8d-49e6-978b-bc2d710befdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:07.001253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcd366-ca8d-49e6-978b-bc2d710befdb service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:07.001529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcd366-ca8d-49e6-978b-bc2d710befdb service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:07.001798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fcd366-ca8d-49e6-978b-bc2d710befdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:07.003489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-73fcd366-ca8d-49e6-978b-bc2d710befdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:07.120093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcd366-ca8d-49e6-978b-bc2d710befdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:07.121719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fcd366-ca8d-49e6-978b-bc2d710befdb service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:07.140723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 671/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:07.199720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf26319-2a87-4b46-abaf-9ec674979016 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:07.200194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf26319-2a87-4b46-abaf-9ec674979016 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:07.200321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf26319-2a87-4b46-abaf-9ec674979016 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:07.201616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 698/1369] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:07.207059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735855-09c9-40f1-860f-001cff6f5d87 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:07.207410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735855-09c9-40f1-860f-001cff6f5d87 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:07.207780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62735855-09c9-40f1-860f-001cff6f5d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:07.249998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:07.295587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-62735855-09c9-40f1-860f-001cff6f5d87 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:07.298276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-62735855-09c9-40f1-860f-001cff6f5d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:07.416965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 672/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:07.748675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495bcb-ede5-4663-b2f7-57cf56fe4736 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:07.748966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495bcb-ede5-4663-b2f7-57cf56fe4736 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:07.749242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c495bcb-ede5-4663-b2f7-57cf56fe4736 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:07.751033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 699/1371] 10.222.0.18 () {54 vars in 963 bytes} [Mon Sep 26 05:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:07.755976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3df7c-2c5b-4ac9-81b6-504d36d88ee4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:07.756267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3df7c-2c5b-4ac9-81b6-504d36d88ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:07.756541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3df7c-2c5b-4ac9-81b6-504d36d88ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:07.838923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b0f3df7c-2c5b-4ac9-81b6-504d36d88ee4 None None] MFA Rules not processed for user `262c0977be384e59a37ef91978012ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:07.840184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b0f3df7c-2c5b-4ac9-81b6-504d36d88ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:07.890487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:07.924314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 673/1372] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Sep 26 05:22:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:07.933641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495bcb-ede5-4663-b2f7-57cf56fe4736 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:07.935268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2c495bcb-ede5-4663-b2f7-57cf56fe4736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:08.049204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c495bcb-ede5-4663-b2f7-57cf56fe4736 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:08.097623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:08.144949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e8fb8-5dfc-4cd3-b127-389a71790681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:08.145577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e8fb8-5dfc-4cd3-b127-389a71790681 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:08.145875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e8fb8-5dfc-4cd3-b127-389a71790681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:08.146192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e8fb8-5dfc-4cd3-b127-389a71790681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:08.147845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e90e8fb8-5dfc-4cd3-b127-389a71790681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:08.337673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e8fb8-5dfc-4cd3-b127-389a71790681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:08.339601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e8fb8-5dfc-4cd3-b127-389a71790681 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:08.367921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 700/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:09.382033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f089aa-8ccd-4af2-bb3f-d5c0ae1b46c9 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:09.382601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f089aa-8ccd-4af2-bb3f-d5c0ae1b46c9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:09.382601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f089aa-8ccd-4af2-bb3f-d5c0ae1b46c9 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:09.384081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 674/1374] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:09.389774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676db130-f606-4ee0-ae86-404a485bfe60 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:09.390209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676db130-f606-4ee0-ae86-404a485bfe60 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:09.390385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676db130-f606-4ee0-ae86-404a485bfe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:09.459932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-676db130-f606-4ee0-ae86-404a485bfe60 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:09.461147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-676db130-f606-4ee0-ae86-404a485bfe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:09.483806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:09.564190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 701/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:09.853972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f089aa-8ccd-4af2-bb3f-d5c0ae1b46c9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:09.855578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-05f089aa-8ccd-4af2-bb3f-d5c0ae1b46c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:10.027013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f089aa-8ccd-4af2-bb3f-d5c0ae1b46c9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:10.081103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:10.145571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add2fae-4dd2-4c47-a6db-fde3fdccc345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:10.146179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2fae-4dd2-4c47-a6db-fde3fdccc345 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:10.146457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2fae-4dd2-4c47-a6db-fde3fdccc345 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:10.146720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add2fae-4dd2-4c47-a6db-fde3fdccc345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:10.148360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3add2fae-4dd2-4c47-a6db-fde3fdccc345 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:10.243413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add2fae-4dd2-4c47-a6db-fde3fdccc345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:10.245180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3add2fae-4dd2-4c47-a6db-fde3fdccc345 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:10.264976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 675/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:22:12.501476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71bf9-3c11-4c1a-b97a-c2a2787017b0 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:12.502063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71bf9-3c11-4c1a-b97a-c2a2787017b0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:12.502063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd71bf9-3c11-4c1a-b97a-c2a2787017b0 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:12.503534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 702/1377] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:12.509223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e116-4fe9-4804-9ffd-2242f6e9decd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:12.509667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e116-4fe9-4804-9ffd-2242f6e9decd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:12.509961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6e116-4fe9-4804-9ffd-2242f6e9decd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:12.583580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2bf6e116-4fe9-4804-9ffd-2242f6e9decd None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:12.584917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2bf6e116-4fe9-4804-9ffd-2242f6e9decd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:12.593332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:12.707589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 676/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:12.991404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd71bf9-3c11-4c1a-b97a-c2a2787017b0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:12.993104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1dd71bf9-3c11-4c1a-b97a-c2a2787017b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:13.156079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd71bf9-3c11-4c1a-b97a-c2a2787017b0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:13.160392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:13.279252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299ecf9-d042-4777-aebd-9f9bebbd79ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:13.279804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ecf9-d042-4777-aebd-9f9bebbd79ae service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:13.280069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ecf9-d042-4777-aebd-9f9bebbd79ae service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:13.280336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299ecf9-d042-4777-aebd-9f9bebbd79ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:13.284211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8299ecf9-d042-4777-aebd-9f9bebbd79ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:13.381745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ecf9-d042-4777-aebd-9f9bebbd79ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:13.383479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299ecf9-d042-4777-aebd-9f9bebbd79ae service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:13.403836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 703/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:15.628015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82b21-b0d1-4263-b45b-f290df118897 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:15.628505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82b21-b0d1-4263-b45b-f290df118897 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:15.628600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82b21-b0d1-4263-b45b-f290df118897 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:15.630112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 677/1380] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:15.635304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a29e-66cb-401c-a21b-cafa9bf9f2d1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:15.635768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a29e-66cb-401c-a21b-cafa9bf9f2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:15.635883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714a29e-66cb-401c-a21b-cafa9bf9f2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:15.647295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:15.707520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1714a29e-66cb-401c-a21b-cafa9bf9f2d1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:15.709178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1714a29e-66cb-401c-a21b-cafa9bf9f2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:15.847995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 704/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:22:16.141472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82b21-b0d1-4263-b45b-f290df118897 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:16.143104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-68b82b21-b0d1-4263-b45b-f290df118897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:16.294041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:16.306074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82b21-b0d1-4263-b45b-f290df118897 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:16.436871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5b7b-3569-4235-b3a9-090ac1070f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:16.437606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b7b-3569-4235-b3a9-090ac1070f21 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:16.437606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b7b-3569-4235-b3a9-090ac1070f21 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:16.438281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b7b-3569-4235-b3a9-090ac1070f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:16.439493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-29df5b7b-3569-4235-b3a9-090ac1070f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:16.547045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5b7b-3569-4235-b3a9-090ac1070f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:16.548731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df5b7b-3569-4235-b3a9-090ac1070f21 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:16.559379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:16.569312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 678/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:18.851343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a432d28-ed48-44f8-88da-537335673c59 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:18.852128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a432d28-ed48-44f8-88da-537335673c59 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:18.852128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a432d28-ed48-44f8-88da-537335673c59 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:18.853422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 705/1383] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:18.859483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f5868-34dd-4790-b8d1-1463f4d83bb8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:18.859989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f5868-34dd-4790-b8d1-1463f4d83bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:18.860167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f5868-34dd-4790-b8d1-1463f4d83bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:18.939117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fd3f5868-34dd-4790-b8d1-1463f4d83bb8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:18.940718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fd3f5868-34dd-4790-b8d1-1463f4d83bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:19.062091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 679/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:22:19.353705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a432d28-ed48-44f8-88da-537335673c59 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:19.355358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5a432d28-ed48-44f8-88da-537335673c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:19.455500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:19.525310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a432d28-ed48-44f8-88da-537335673c59 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:19.675654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4c4db-ca45-4859-b5da-e58c1d744e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:19.677603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c4db-ca45-4859-b5da-e58c1d744e63 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:19.678281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c4db-ca45-4859-b5da-e58c1d744e63 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:19.678836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4c4db-ca45-4859-b5da-e58c1d744e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:19.681037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-98b4c4db-ca45-4859-b5da-e58c1d744e63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:19.758911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:19.807207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c4db-ca45-4859-b5da-e58c1d744e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:19.808921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4c4db-ca45-4859-b5da-e58c1d744e63 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:19.828356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 706/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:22.183905 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa0b47-3073-45a5-9b3d-3be10d8fe9d2 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:22.184523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa0b47-3073-45a5-9b3d-3be10d8fe9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:22.184672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa0b47-3073-45a5-9b3d-3be10d8fe9d2 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:22.186596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 680/1386] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:22.192124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e339fb7-7cec-4244-8349-fc6599d610b0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:22.192607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e339fb7-7cec-4244-8349-fc6599d610b0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:22.192707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e339fb7-7cec-4244-8349-fc6599d610b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:22.262325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9e339fb7-7cec-4244-8349-fc6599d610b0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:22.263634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9e339fb7-7cec-4244-8349-fc6599d610b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:22.375019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 707/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:22.670993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa0b47-3073-45a5-9b3d-3be10d8fe9d2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:22.673615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-92fa0b47-3073-45a5-9b3d-3be10d8fe9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:22.783423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:22.859420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa0b47-3073-45a5-9b3d-3be10d8fe9d2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:23.004923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33b80-0544-4c25-90df-4bacb13357e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:23.005538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33b80-0544-4c25-90df-4bacb13357e9 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:23.005817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33b80-0544-4c25-90df-4bacb13357e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:23.006076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33b80-0544-4c25-90df-4bacb13357e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:23.007748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2cf33b80-0544-4c25-90df-4bacb13357e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:23.055502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:23.115178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf33b80-0544-4c25-90df-4bacb13357e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:23.116879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf33b80-0544-4c25-90df-4bacb13357e9 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:23.137431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 681/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:25.599983 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83b6cd-a818-4904-a724-5b2f58139b01 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:25.600526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83b6cd-a818-4904-a724-5b2f58139b01 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:25.600526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83b6cd-a818-4904-a724-5b2f58139b01 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:25.602046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 708/1389] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:25.607830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf7250-819a-4a39-b429-3b5191403de8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:25.608254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf7250-819a-4a39-b429-3b5191403de8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:25.608367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf7250-819a-4a39-b429-3b5191403de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:25.677046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dbbf7250-819a-4a39-b429-3b5191403de8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:25.678261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dbbf7250-819a-4a39-b429-3b5191403de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:25.777481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 682/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:26.071312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83b6cd-a818-4904-a724-5b2f58139b01 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:26.072891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cf83b6cd-a818-4904-a724-5b2f58139b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:26.107210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:26.226449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83b6cd-a818-4904-a724-5b2f58139b01 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:26.339133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:26.351214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2646534-2cd9-45a7-aad0-e5a3c95bc07e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:26.351991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646534-2cd9-45a7-aad0-e5a3c95bc07e service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:26.352593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646534-2cd9-45a7-aad0-e5a3c95bc07e service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:26.353251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2646534-2cd9-45a7-aad0-e5a3c95bc07e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:26.354870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a2646534-2cd9-45a7-aad0-e5a3c95bc07e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:26.452194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646534-2cd9-45a7-aad0-e5a3c95bc07e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:26.453814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2646534-2cd9-45a7-aad0-e5a3c95bc07e service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:26.474984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 709/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:26.631205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b446a8-47f8-4846-9498-17c7476c2dcc None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:26.631849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b446a8-47f8-4846-9498-17c7476c2dcc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:26.631849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b446a8-47f8-4846-9498-17c7476c2dcc None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:26.633126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 683/1392] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:26.639258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde5baf-7c89-43ab-963b-1d71e830214b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:26.639840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde5baf-7c89-43ab-963b-1d71e830214b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:26.639840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde5baf-7c89-43ab-963b-1d71e830214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:26.731323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1dde5baf-7c89-43ab-963b-1d71e830214b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:26.732583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1dde5baf-7c89-43ab-963b-1d71e830214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:26.792064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:26.832893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 710/1393] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:27.128418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb73dfe-e628-4b6c-af8f-88c516332db6 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:27.128700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb73dfe-e628-4b6c-af8f-88c516332db6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:27.128971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb73dfe-e628-4b6c-af8f-88c516332db6 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:27.130302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 684/1394] 10.222.0.18 () {54 vars in 962 bytes} [Mon Sep 26 05:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:27.135873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a83d46-5701-438f-9ee2-171fc19f966b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:27.136162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a83d46-5701-438f-9ee2-171fc19f966b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:27.136435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a83d46-5701-438f-9ee2-171fc19f966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:27.215154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b3a83d46-5701-438f-9ee2-171fc19f966b None None] MFA Rules not processed for user `1d78fc219a25457ca11e38930b03e8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:27.216386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b3a83d46-5701-438f-9ee2-171fc19f966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:27.307987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 711/1395] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Sep 26 05:22:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:27.316120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb73dfe-e628-4b6c-af8f-88c516332db6 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:27.317645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6bb73dfe-e628-4b6c-af8f-88c516332db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:27.332612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:27.433867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb73dfe-e628-4b6c-af8f-88c516332db6 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:27.511241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73b1d-22d2-4687-a6a2-5df6c4566f49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78fc219a25457ca11e38930b03e8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:27.511912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73b1d-22d2-4687-a6a2-5df6c4566f49 service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:27.512186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73b1d-22d2-4687-a6a2-5df6c4566f49 service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:27.512453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73b1d-22d2-4687-a6a2-5df6c4566f49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:27.514089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c0f73b1d-22d2-4687-a6a2-5df6c4566f49 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:27.582004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:27.625313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73b1d-22d2-4687-a6a2-5df6c4566f49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:27.626793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73b1d-22d2-4687-a6a2-5df6c4566f49 service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:27.646267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 685/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:28.400713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6214864-01c4-4f2d-be88-e699557053ec None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:28.401269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6214864-01c4-4f2d-be88-e699557053ec None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:28.401269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6214864-01c4-4f2d-be88-e699557053ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:28.470382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d6214864-01c4-4f2d-be88-e699557053ec None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:28.471653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d6214864-01c4-4f2d-be88-e699557053ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:28.480716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:28.567150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 712/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:22:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:28.613149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb94d2-c92a-4505-82a2-0d70ec99ac2d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:28.613442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb94d2-c92a-4505-82a2-0d70ec99ac2d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:28.613746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb94d2-c92a-4505-82a2-0d70ec99ac2d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:28.615099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 686/1398] 10.222.0.18 () {54 vars in 943 bytes} [Mon Sep 26 05:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:28.622073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480440-119b-4a0f-8a72-048eac02db2e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:28.622378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480440-119b-4a0f-8a72-048eac02db2e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:28.622651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480440-119b-4a0f-8a72-048eac02db2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:28.675195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f9d1-8f39-4b1d-a029-517be412e845 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:28.675792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f9d1-8f39-4b1d-a029-517be412e845 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:28.675792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2f9d1-8f39-4b1d-a029-517be412e845 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:28.678004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 687/1399] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:28.683316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:28.683630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:28.683934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:28.701854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4d480440-119b-4a0f-8a72-048eac02db2e None None] MFA Rules not processed for user `4f85a6800f914551b065fedc9bd4b558`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:28.703076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4d480440-119b-4a0f-8a72-048eac02db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:28.750756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:28.752122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:28.790716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:28.814355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 713/1400] 10.222.0.18 () {58 vars in 1040 bytes} [Mon Sep 26 05:22:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:28.824040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d480440-119b-4a0f-8a72-048eac02db2e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:28.833672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d480440-119b-4a0f-8a72-048eac02db2e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:28.852278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 688/1401] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:22:28.943378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0248b6-e98f-4fed-8d31-0687a06eb4f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:28.943935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0248b6-e98f-4fed-8d31-0687a06eb4f8 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:28.944214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0248b6-e98f-4fed-8d31-0687a06eb4f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:28.944484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0248b6-e98f-4fed-8d31-0687a06eb4f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:28.946172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ea0248b6-e98f-4fed-8d31-0687a06eb4f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:29.032474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0248b6-e98f-4fed-8d31-0687a06eb4f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:29.034065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0248b6-e98f-4fed-8d31-0687a06eb4f8 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:29.042161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 714/1402] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:22:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:22:29.150650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:29.152206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:29.189344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:29.290399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c0a63-abf3-434a-b416-b8a8e9efad28 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:29.420694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e1588-1e8d-4d2f-a029-98796efde702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:29.421301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1588-1e8d-4d2f-a029-98796efde702 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:29.421573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1588-1e8d-4d2f-a029-98796efde702 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:29.421839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e1588-1e8d-4d2f-a029-98796efde702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:29.423593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d23e1588-1e8d-4d2f-a029-98796efde702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:29.443790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:29.520767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e1588-1e8d-4d2f-a029-98796efde702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:29.522379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e1588-1e8d-4d2f-a029-98796efde702 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:29.546740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 689/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:31.806084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c99d7e-72cb-42ac-a3b2-57bd1509a865 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:31.807459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c99d7e-72cb-42ac-a3b2-57bd1509a865 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:31.807773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c99d7e-72cb-42ac-a3b2-57bd1509a865 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:31.809415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 715/1404] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:31.815078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7277cd-01e8-463d-8413-5a6fc8f2c102 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:31.815630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7277cd-01e8-463d-8413-5a6fc8f2c102 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:31.815741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7277cd-01e8-463d-8413-5a6fc8f2c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:31.888415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9a7277cd-01e8-463d-8413-5a6fc8f2c102 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:31.889629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9a7277cd-01e8-463d-8413-5a6fc8f2c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:31.994976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:32.003580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 690/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:22:32.288660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c99d7e-72cb-42ac-a3b2-57bd1509a865 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:32.290331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-98c99d7e-72cb-42ac-a3b2-57bd1509a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:32.301653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:32.456286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c99d7e-72cb-42ac-a3b2-57bd1509a865 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:32.542253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:32.577494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466dcf6-b1c9-4db9-81cf-74fd2216924b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:32.578110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466dcf6-b1c9-4db9-81cf-74fd2216924b service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:32.578387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466dcf6-b1c9-4db9-81cf-74fd2216924b service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:32.578660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466dcf6-b1c9-4db9-81cf-74fd2216924b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:32.580339 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8466dcf6-b1c9-4db9-81cf-74fd2216924b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:32.672967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466dcf6-b1c9-4db9-81cf-74fd2216924b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:32.674589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466dcf6-b1c9-4db9-81cf-74fd2216924b service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:32.696250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 716/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:34.907832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f55c-e9fb-4de4-a800-fd4d54669441 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:34.908442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f55c-e9fb-4de4-a800-fd4d54669441 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:34.908442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379f55c-e9fb-4de4-a800-fd4d54669441 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:34.909722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 691/1407] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:22:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:34.917576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af6a5-21ca-4611-b261-9a926a5457fb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:34.917576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af6a5-21ca-4611-b261-9a926a5457fb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:34.917576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1af6a5-21ca-4611-b261-9a926a5457fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:34.994806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8c1af6a5-21ca-4611-b261-9a926a5457fb None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:34.996443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8c1af6a5-21ca-4611-b261-9a926a5457fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:35.061848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:35.123583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 717/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:35.412138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379f55c-e9fb-4de4-a800-fd4d54669441 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:35.413725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8379f55c-e9fb-4de4-a800-fd4d54669441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:35.573502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379f55c-e9fb-4de4-a800-fd4d54669441 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:35.656199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:35.705572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbad0f-1e57-46a8-8f66-2bce228d574c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:35.706184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbad0f-1e57-46a8-8f66-2bce228d574c service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:35.706462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbad0f-1e57-46a8-8f66-2bce228d574c service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:35.706731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbad0f-1e57-46a8-8f66-2bce228d574c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:35.708361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-41bbad0f-1e57-46a8-8f66-2bce228d574c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:35.812009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbad0f-1e57-46a8-8f66-2bce228d574c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:35.814253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbad0f-1e57-46a8-8f66-2bce228d574c service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:35.834302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 692/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:45.118064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=23 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:45.831630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=64 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:52.011958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6667-ebbc-4863-87bd-48be96d88d69 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:52.012579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6667-ebbc-4863-87bd-48be96d88d69 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:52.012579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a6667-ebbc-4863-87bd-48be96d88d69 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:52.013877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 718/1410] 10.222.0.18 () {54 vars in 918 bytes} [Mon Sep 26 05:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:52.019305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c072d-35cf-4ebc-a54f-ef89c6bb57e0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:52.019777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c072d-35cf-4ebc-a54f-ef89c6bb57e0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:52.019872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c072d-35cf-4ebc-a54f-ef89c6bb57e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:52.098306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b99c072d-35cf-4ebc-a54f-ef89c6bb57e0 None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:52.099511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b99c072d-35cf-4ebc-a54f-ef89c6bb57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:52.212607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 693/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Sep 26 05:22:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:22:52.227717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa3cd-7ff4-433f-b16b-9a0126bce4c0 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:52.227895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa3cd-7ff4-433f-b16b-9a0126bce4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:52.228189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa3cd-7ff4-433f-b16b-9a0126bce4c0 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:52.229548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 719/1412] 10.222.0.18 () {54 vars in 918 bytes} [Mon Sep 26 05:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:52.235306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b057c-2586-4e50-9d1e-6157102c74b5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:52.235735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b057c-2586-4e50-9d1e-6157102c74b5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:52.236124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b057c-2586-4e50-9d1e-6157102c74b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:52.315565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:52.319105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-451b057c-2586-4e50-9d1e-6157102c74b5 None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:52.321149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-451b057c-2586-4e50-9d1e-6157102c74b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:52.444170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 694/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Sep 26 05:22:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:55.055588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b5f6-c1bf-4018-9c23-029e1be38cfc None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:55.056177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b5f6-c1bf-4018-9c23-029e1be38cfc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:55.056177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b5f6-c1bf-4018-9c23-029e1be38cfc None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:55.057864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:22:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:55.066770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e870-2729-4d17-abc4-ce6b13177c9e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:55.067393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e870-2729-4d17-abc4-ce6b13177c9e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:55.067600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e870-2729-4d17-abc4-ce6b13177c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:55.145925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6932e870-2729-4d17-abc4-ce6b13177c9e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:55.147080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6932e870-2729-4d17-abc4-ce6b13177c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:55.208593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:55.254847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:55.563414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3b5f6-c1bf-4018-9c23-029e1be38cfc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:55.565047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4ca3b5f6-c1bf-4018-9c23-029e1be38cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:55.861186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3b5f6-c1bf-4018-9c23-029e1be38cfc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:55.941779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:55.985125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad696d-2308-4849-b84e-82e878c94f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:55.985739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad696d-2308-4849-b84e-82e878c94f22 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:55.986013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad696d-2308-4849-b84e-82e878c94f22 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:55.986284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad696d-2308-4849-b84e-82e878c94f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:55.987914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-69ad696d-2308-4849-b84e-82e878c94f22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:56.089816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad696d-2308-4849-b84e-82e878c94f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:56.091905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad696d-2308-4849-b84e-82e878c94f22 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:56.114480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 721/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:57.299173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159078-eb5e-4bff-b4e8-060060ed2fb8 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:57.299976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159078-eb5e-4bff-b4e8-060060ed2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:57.300132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0159078-eb5e-4bff-b4e8-060060ed2fb8 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:57.302157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:22:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:57.309986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c774-cfbc-41fb-b021-3d7d32a98fa3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:57.310494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c774-cfbc-41fb-b021-3d7d32a98fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:57.310494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c774-cfbc-41fb-b021-3d7d32a98fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:57.388924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-df76c774-cfbc-41fb-b021-3d7d32a98fa3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:57.390139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-df76c774-cfbc-41fb-b021-3d7d32a98fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:57.418911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:57.491701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:57.672455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159078-eb5e-4bff-b4e8-060060ed2fb8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:57.674874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c0159078-eb5e-4bff-b4e8-060060ed2fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:57.837238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0159078-eb5e-4bff-b4e8-060060ed2fb8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:57.882653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:57.973050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1ea21-b583-4abc-a60d-d6a81ffa410b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:57.973572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ea21-b583-4abc-a60d-d6a81ffa410b service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:57.973825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ea21-b583-4abc-a60d-d6a81ffa410b service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:57.974096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1ea21-b583-4abc-a60d-d6a81ffa410b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:57.975742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dee1ea21-b583-4abc-a60d-d6a81ffa410b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:58.075020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ea21-b583-4abc-a60d-d6a81ffa410b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:22:58.076685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1ea21-b583-4abc-a60d-d6a81ffa410b service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:22:58.095557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 697/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:22:59.249513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c43159-fb0e-434d-b341-e993126024fa None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:59.250143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c43159-fb0e-434d-b341-e993126024fa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:59.250143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c43159-fb0e-434d-b341-e993126024fa None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:59.251373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:22:59.260726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90862c-5a57-4d83-9527-682cce76c314 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:59.261196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90862c-5a57-4d83-9527-682cce76c314 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:59.261304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90862c-5a57-4d83-9527-682cce76c314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:59.326766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:59.350272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2b90862c-5a57-4d83-9527-682cce76c314 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:22:59.351500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2b90862c-5a57-4d83-9527-682cce76c314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:59.454272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:22:59.608108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c43159-fb0e-434d-b341-e993126024fa None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:22:59.610570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-09c43159-fb0e-434d-b341-e993126024fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:22:59.767683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c43159-fb0e-434d-b341-e993126024fa None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:22:59.780443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:22:59.892009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35a18-b16f-4665-a6e6-73487c6b3da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:22:59.892619 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35a18-b16f-4665-a6e6-73487c6b3da9 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:22:59.892886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35a18-b16f-4665-a6e6-73487c6b3da9 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:22:59.893161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35a18-b16f-4665-a6e6-73487c6b3da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:22:59.894731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eaa35a18-b16f-4665-a6e6-73487c6b3da9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:00.004721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35a18-b16f-4665-a6e6-73487c6b3da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:00.007011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35a18-b16f-4665-a6e6-73487c6b3da9 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:00.027106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 724/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:22:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:01.172750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fda14-c0b7-4843-84a1-c2cb2127883a None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:01.173273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fda14-c0b7-4843-84a1-c2cb2127883a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:01.173273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074fda14-c0b7-4843-84a1-c2cb2127883a None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:01.174948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:01.182331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a65b-749f-4217-90b8-3e40864e3fd7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:01.182885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a65b-749f-4217-90b8-3e40864e3fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:01.182885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a65b-749f-4217-90b8-3e40864e3fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:01.204171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:01.265505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4406a65b-749f-4217-90b8-3e40864e3fd7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:01.266714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4406a65b-749f-4217-90b8-3e40864e3fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:01.371067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:01.536243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fda14-c0b7-4843-84a1-c2cb2127883a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:01.537969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-074fda14-c0b7-4843-84a1-c2cb2127883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:01.683172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:01.725705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074fda14-c0b7-4843-84a1-c2cb2127883a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:01.861927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da613b-6bb2-4846-82b2-b8cd444e4674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:01.862699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da613b-6bb2-4846-82b2-b8cd444e4674 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:01.862981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da613b-6bb2-4846-82b2-b8cd444e4674 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:01.863295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da613b-6bb2-4846-82b2-b8cd444e4674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:01.865813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a9da613b-6bb2-4846-82b2-b8cd444e4674 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:01.950458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:01.964799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da613b-6bb2-4846-82b2-b8cd444e4674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:01.966452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da613b-6bb2-4846-82b2-b8cd444e4674 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:01.984655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 700/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:03.116415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48b11c-a359-4605-9d43-862693bc8560 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:03.116912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48b11c-a359-4605-9d43-862693bc8560 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:03.116912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48b11c-a359-4605-9d43-862693bc8560 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:03.118498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:03.126131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573a427-eaf8-4ed8-b779-61fa4d213fe9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:03.126955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573a427-eaf8-4ed8-b779-61fa4d213fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:03.126955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573a427-eaf8-4ed8-b779-61fa4d213fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:03.210366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0573a427-eaf8-4ed8-b779-61fa4d213fe9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:03.212004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0573a427-eaf8-4ed8-b779-61fa4d213fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:03.311741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:03.463380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48b11c-a359-4605-9d43-862693bc8560 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:03.464929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cc48b11c-a359-4605-9d43-862693bc8560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:03.554232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:03.619133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48b11c-a359-4605-9d43-862693bc8560 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:03.744363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f50d4e-2e64-4035-bbb6-b4eb3004fe46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:03.744881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50d4e-2e64-4035-bbb6-b4eb3004fe46 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:03.745155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50d4e-2e64-4035-bbb6-b4eb3004fe46 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:03.745421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50d4e-2e64-4035-bbb6-b4eb3004fe46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:03.747026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-93f50d4e-2e64-4035-bbb6-b4eb3004fe46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:03.801304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:03.844262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f50d4e-2e64-4035-bbb6-b4eb3004fe46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:03.845849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f50d4e-2e64-4035-bbb6-b4eb3004fe46 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:03.863969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 727/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:04.954105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba7cf-8fdf-4827-8622-c33b7942a1a7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:04.954687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba7cf-8fdf-4827-8622-c33b7942a1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:04.954687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba7cf-8fdf-4827-8622-c33b7942a1a7 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:04.956079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:04.967832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2703b0-9ecb-4e2c-83ab-be0bac2083cd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:04.968334 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2703b0-9ecb-4e2c-83ab-be0bac2083cd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:04.968432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2703b0-9ecb-4e2c-83ab-be0bac2083cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:05.061291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-cf2703b0-9ecb-4e2c-83ab-be0bac2083cd None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:05.062513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cf2703b0-9ecb-4e2c-83ab-be0bac2083cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:05.161562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:05.314357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba7cf-8fdf-4827-8622-c33b7942a1a7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:05.315947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-703ba7cf-8fdf-4827-8622-c33b7942a1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:05.366487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:05.473449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba7cf-8fdf-4827-8622-c33b7942a1a7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:05.603946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd806-a722-4fb4-8db4-1ef6fe41a313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:05.604486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd806-a722-4fb4-8db4-1ef6fe41a313 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:05.604765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd806-a722-4fb4-8db4-1ef6fe41a313 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:05.605037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd806-a722-4fb4-8db4-1ef6fe41a313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:05.606656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c15dd806-a722-4fb4-8db4-1ef6fe41a313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:05.613814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:05.713837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd806-a722-4fb4-8db4-1ef6fe41a313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:05.715476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd806-a722-4fb4-8db4-1ef6fe41a313 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:05.735106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 703/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:06.793221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c518-c6b2-4387-9a8f-88b439909fbb None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:06.793840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c518-c6b2-4387-9a8f-88b439909fbb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:06.793840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074c518-c6b2-4387-9a8f-88b439909fbb None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:06.795124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:06.801619 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319024f6-7521-4368-b50e-966ce972f25c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:06.802090 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319024f6-7521-4368-b50e-966ce972f25c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:06.802188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319024f6-7521-4368-b50e-966ce972f25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:06.882667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-319024f6-7521-4368-b50e-966ce972f25c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:06.884042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-319024f6-7521-4368-b50e-966ce972f25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:06.961144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:06.992747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:07.143962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074c518-c6b2-4387-9a8f-88b439909fbb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:07.146302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0074c518-c6b2-4387-9a8f-88b439909fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:07.166178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:07.303774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074c518-c6b2-4387-9a8f-88b439909fbb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:07.399027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:07.426439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfab1f-d5a9-461b-a30c-60001262190d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:07.427035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfab1f-d5a9-461b-a30c-60001262190d service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:07.427306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfab1f-d5a9-461b-a30c-60001262190d service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:07.427535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfab1f-d5a9-461b-a30c-60001262190d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:07.429310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-00dfab1f-d5a9-461b-a30c-60001262190d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:07.522759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfab1f-d5a9-461b-a30c-60001262190d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:07.524763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfab1f-d5a9-461b-a30c-60001262190d service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:07.543478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 730/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:08.591909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72779c1e-3403-483e-b8c8-893b1a7ab315 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:08.592452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72779c1e-3403-483e-b8c8-893b1a7ab315 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:08.592452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72779c1e-3403-483e-b8c8-893b1a7ab315 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:08.594373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:23:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:08.605227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efbdb0-e1c1-42fc-90ea-7d01148f4615 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:08.605662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efbdb0-e1c1-42fc-90ea-7d01148f4615 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:08.605798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efbdb0-e1c1-42fc-90ea-7d01148f4615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:08.689776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-09efbdb0-e1c1-42fc-90ea-7d01148f4615 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:08.691001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-09efbdb0-e1c1-42fc-90ea-7d01148f4615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:08.733513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:08.790345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:08.948840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72779c1e-3403-483e-b8c8-893b1a7ab315 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:08.951162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-72779c1e-3403-483e-b8c8-893b1a7ab315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:09.112377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72779c1e-3403-483e-b8c8-893b1a7ab315 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:09.170611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:09.233851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d1ddc-84d5-495d-82e3-4dc98364c729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:09.234417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1ddc-84d5-495d-82e3-4dc98364c729 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:09.234688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1ddc-84d5-495d-82e3-4dc98364c729 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:09.234971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1ddc-84d5-495d-82e3-4dc98364c729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:09.236644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-902d1ddc-84d5-495d-82e3-4dc98364c729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:09.340200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d1ddc-84d5-495d-82e3-4dc98364c729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:09.341848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d1ddc-84d5-495d-82e3-4dc98364c729 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:09.365704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 706/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:10.439261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e65e-478c-450c-b551-69852ff4fb36 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:10.440217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e65e-478c-450c-b551-69852ff4fb36 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:10.440217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e65e-478c-450c-b551-69852ff4fb36 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:10.442384 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:23:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:10.448882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d188e-c4e3-4456-9c73-965d7ba067ce None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:10.449367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d188e-c4e3-4456-9c73-965d7ba067ce None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:10.449463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d188e-c4e3-4456-9c73-965d7ba067ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:10.529026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d34d188e-c4e3-4456-9c73-965d7ba067ce None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:10.530260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d34d188e-c4e3-4456-9c73-965d7ba067ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:10.532390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:10.633135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:10.790354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873e65e-478c-450c-b551-69852ff4fb36 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:10.792911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4873e65e-478c-450c-b551-69852ff4fb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:10.956293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873e65e-478c-450c-b551-69852ff4fb36 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:10.984582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:11.084468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcaf46-ca85-4aad-ba3a-a664021871a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:11.085080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcaf46-ca85-4aad-ba3a-a664021871a8 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:11.085387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcaf46-ca85-4aad-ba3a-a664021871a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:11.085660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcaf46-ca85-4aad-ba3a-a664021871a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:11.087278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-36bcaf46-ca85-4aad-ba3a-a664021871a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:11.188382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcaf46-ca85-4aad-ba3a-a664021871a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:11.189991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcaf46-ca85-4aad-ba3a-a664021871a8 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:11.208583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 733/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:13.259293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72bee-56b3-411d-8c7c-7472282ea910 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:13.259972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72bee-56b3-411d-8c7c-7472282ea910 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:13.259972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b72bee-56b3-411d-8c7c-7472282ea910 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:13.261188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:13.266777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee26bf-9a3a-438b-9398-c0ea37c8582b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:13.267235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee26bf-9a3a-438b-9398-c0ea37c8582b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:13.267341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee26bf-9a3a-438b-9398-c0ea37c8582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:13.309902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:13.337540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6cee26bf-9a3a-438b-9398-c0ea37c8582b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:13.338753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6cee26bf-9a3a-438b-9398-c0ea37c8582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:13.447283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:13.731628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72bee-56b3-411d-8c7c-7472282ea910 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:13.734180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-61b72bee-56b3-411d-8c7c-7472282ea910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:13.862440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b72bee-56b3-411d-8c7c-7472282ea910 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:13.896757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:13.943396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e38264-b583-467d-b5b7-bf024549e9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:13.944029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38264-b583-467d-b5b7-bf024549e9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:13.944299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38264-b583-467d-b5b7-bf024549e9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:13.944548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38264-b583-467d-b5b7-bf024549e9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:13.946190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-04e38264-b583-467d-b5b7-bf024549e9d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:14.063892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e38264-b583-467d-b5b7-bf024549e9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:14.065235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e38264-b583-467d-b5b7-bf024549e9d4 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:14.083816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 709/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:16.367287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76480757-7ec4-4c47-bbee-bebf6df991cf None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:16.368280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76480757-7ec4-4c47-bbee-bebf6df991cf None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:16.368502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76480757-7ec4-4c47-bbee-bebf6df991cf None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:16.370710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:16.379800 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d113-0925-4219-a92d-042f99533275 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:16.380552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d113-0925-4219-a92d-042f99533275 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:16.380732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123d113-0925-4219-a92d-042f99533275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:16.448008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9123d113-0925-4219-a92d-042f99533275 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:16.449221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9123d113-0925-4219-a92d-042f99533275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:16.462439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:16.548884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:16.828910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76480757-7ec4-4c47-bbee-bebf6df991cf None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:16.830470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-76480757-7ec4-4c47-bbee-bebf6df991cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:16.939378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76480757-7ec4-4c47-bbee-bebf6df991cf None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:16.956411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:17.022255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc41cb8-8925-4a66-9660-74e8a14ab9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:17.022856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41cb8-8925-4a66-9660-74e8a14ab9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:17.023127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41cb8-8925-4a66-9660-74e8a14ab9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:17.023388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc41cb8-8925-4a66-9660-74e8a14ab9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:17.025126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dcc41cb8-8925-4a66-9660-74e8a14ab9a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:17.171331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc41cb8-8925-4a66-9660-74e8a14ab9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:17.172805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc41cb8-8925-4a66-9660-74e8a14ab9a2 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:17.192291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 736/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:19.685409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3af94-07d1-462f-8963-dc8b65fef41d None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:19.686291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3af94-07d1-462f-8963-dc8b65fef41d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:19.686291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3af94-07d1-462f-8963-dc8b65fef41d None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:19.688557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:19.694946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc4f0-18b8-4c81-b54d-04d50916bb0e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:19.695715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc4f0-18b8-4c81-b54d-04d50916bb0e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:19.695967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc4f0-18b8-4c81-b54d-04d50916bb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:19.752348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:19.771208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bfecc4f0-18b8-4c81-b54d-04d50916bb0e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:19.772493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bfecc4f0-18b8-4c81-b54d-04d50916bb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:19.885256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:20.168260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3af94-07d1-462f-8963-dc8b65fef41d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:20.169823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-13c3af94-07d1-462f-8963-dc8b65fef41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:20.282366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3af94-07d1-462f-8963-dc8b65fef41d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:20.326635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:20.361286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d602e3-09c4-49b9-938e-d180964a941b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:20.361891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d602e3-09c4-49b9-938e-d180964a941b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:20.362172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d602e3-09c4-49b9-938e-d180964a941b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:20.362447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d602e3-09c4-49b9-938e-d180964a941b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:20.364105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d6d602e3-09c4-49b9-938e-d180964a941b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:20.484348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d602e3-09c4-49b9-938e-d180964a941b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:20.485712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d602e3-09c4-49b9-938e-d180964a941b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:20.505420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 712/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:22.802528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be09ad-3d04-492c-8604-79d646b0c2fd None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:22.803116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be09ad-3d04-492c-8604-79d646b0c2fd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:22.803116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be09ad-3d04-492c-8604-79d646b0c2fd None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:22.804452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:22.811423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aca2f-6765-4984-a8bd-d0105bba305b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:22.812219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aca2f-6765-4984-a8bd-d0105bba305b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:22.812425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453aca2f-6765-4984-a8bd-d0105bba305b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:22.892583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-453aca2f-6765-4984-a8bd-d0105bba305b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:22.893939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-453aca2f-6765-4984-a8bd-d0105bba305b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:22.917829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:23.023045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:23.327633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be09ad-3d04-492c-8604-79d646b0c2fd None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:23.329205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e0be09ad-3d04-492c-8604-79d646b0c2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:23.464918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be09ad-3d04-492c-8604-79d646b0c2fd None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:23.489586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:23.556384 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1eb99-a6e8-4016-a5aa-c9fb865dc2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:23.557360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1eb99-a6e8-4016-a5aa-c9fb865dc2df service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:23.557633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1eb99-a6e8-4016-a5aa-c9fb865dc2df service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:23.557898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1eb99-a6e8-4016-a5aa-c9fb865dc2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:23.559576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-26d1eb99-a6e8-4016-a5aa-c9fb865dc2df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:23.690722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1eb99-a6e8-4016-a5aa-c9fb865dc2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:23.692205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1eb99-a6e8-4016-a5aa-c9fb865dc2df service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:23.717365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 739/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:25.951342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8bd6f-82f1-456f-bbb9-da6668d3fe85 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:25.951940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8bd6f-82f1-456f-bbb9-da6668d3fe85 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:25.951940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8bd6f-82f1-456f-bbb9-da6668d3fe85 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:25.953271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:25.958788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fd69-dd1f-48d0-92ba-afad0256a34a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:25.959232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fd69-dd1f-48d0-92ba-afad0256a34a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:25.959336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0fd69-dd1f-48d0-92ba-afad0256a34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:26.022444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:26.025222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-28a0fd69-dd1f-48d0-92ba-afad0256a34a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:26.026953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-28a0fd69-dd1f-48d0-92ba-afad0256a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:26.138693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:26.423952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8bd6f-82f1-456f-bbb9-da6668d3fe85 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:26.426349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2ee8bd6f-82f1-456f-bbb9-da6668d3fe85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:26.545437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8bd6f-82f1-456f-bbb9-da6668d3fe85 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:26.596251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:26.623634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e35d-196d-4ecb-8e4c-c42885b3e792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:26.624244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e35d-196d-4ecb-8e4c-c42885b3e792 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:26.624517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e35d-196d-4ecb-8e4c-c42885b3e792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:26.624781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e35d-196d-4ecb-8e4c-c42885b3e792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:26.626382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9800e35d-196d-4ecb-8e4c-c42885b3e792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:26.748166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800e35d-196d-4ecb-8e4c-c42885b3e792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:26.749621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800e35d-196d-4ecb-8e4c-c42885b3e792 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:26.768452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 715/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:29.052079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7ecbd-ca76-477b-bab3-6d3a9edc2a1d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:29.053029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7ecbd-ca76-477b-bab3-6d3a9edc2a1d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:29.053029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7ecbd-ca76-477b-bab3-6d3a9edc2a1d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:29.055029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:29.061212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f215e2-ec87-46b4-ba3a-a47b8ecd9bb7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:29.061657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f215e2-ec87-46b4-ba3a-a47b8ecd9bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:29.061774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f215e2-ec87-46b4-ba3a-a47b8ecd9bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:29.130023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a7f215e2-ec87-46b4-ba3a-a47b8ecd9bb7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:29.131243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a7f215e2-ec87-46b4-ba3a-a47b8ecd9bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:29.163051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:29.234698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:29.521146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7ecbd-ca76-477b-bab3-6d3a9edc2a1d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:29.523659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6ec7ecbd-ca76-477b-bab3-6d3a9edc2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:29.631190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7ecbd-ca76-477b-bab3-6d3a9edc2a1d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:29.665666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:29.713656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d905367-142e-4f0b-b767-5c50d6a94b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:29.714265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905367-142e-4f0b-b767-5c50d6a94b17 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:29.714540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905367-142e-4f0b-b767-5c50d6a94b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:29.714813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d905367-142e-4f0b-b767-5c50d6a94b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:29.716454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3d905367-142e-4f0b-b767-5c50d6a94b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:29.830766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d905367-142e-4f0b-b767-5c50d6a94b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:29.832229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d905367-142e-4f0b-b767-5c50d6a94b17 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:29.851077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 742/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:32.091301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf063-1c41-4186-8e34-0013dfaed96c None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:32.092277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf063-1c41-4186-8e34-0013dfaed96c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:32.092277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf063-1c41-4186-8e34-0013dfaed96c None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:32.094324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:32.103181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2d99-b5f9-42b6-81ba-b578fdcd3dfa None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:32.103650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2d99-b5f9-42b6-81ba-b578fdcd3dfa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:32.103749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e2d99-b5f9-42b6-81ba-b578fdcd3dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:32.179750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b89e2d99-b5f9-42b6-81ba-b578fdcd3dfa None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:32.182565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b89e2d99-b5f9-42b6-81ba-b578fdcd3dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:32.196885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:32.296864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:32.610468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf063-1c41-4186-8e34-0013dfaed96c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:32.612080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c1dcf063-1c41-4186-8e34-0013dfaed96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:32.726249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf063-1c41-4186-8e34-0013dfaed96c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:32.793914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:32.813368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed722-ee46-41b3-8f63-454793631553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:32.813981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed722-ee46-41b3-8f63-454793631553 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:32.814252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed722-ee46-41b3-8f63-454793631553 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:32.814517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed722-ee46-41b3-8f63-454793631553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:32.816139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-de4ed722-ee46-41b3-8f63-454793631553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:32.948440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ed722-ee46-41b3-8f63-454793631553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:32.949890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ed722-ee46-41b3-8f63-454793631553 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:32.969484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 718/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:23:35.193739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066c39-0b0e-4248-8898-7ccad1ba7517 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:35.194313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066c39-0b0e-4248-8898-7ccad1ba7517 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:35.194313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066c39-0b0e-4248-8898-7ccad1ba7517 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:35.195790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:35.202360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee9200-fd7d-498a-aae6-840b03f75274 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:35.203127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee9200-fd7d-498a-aae6-840b03f75274 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:35.203319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee9200-fd7d-498a-aae6-840b03f75274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:35.283092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ddee9200-fd7d-498a-aae6-840b03f75274 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:35.284326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ddee9200-fd7d-498a-aae6-840b03f75274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:35.326356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:35.387961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:35.690185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066c39-0b0e-4248-8898-7ccad1ba7517 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:35.692731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-49066c39-0b0e-4248-8898-7ccad1ba7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:35.817122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066c39-0b0e-4248-8898-7ccad1ba7517 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:35.859315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:35.902747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b802270-d0a7-4698-b621-f19026112486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:35.903353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802270-d0a7-4698-b621-f19026112486 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:35.903663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802270-d0a7-4698-b621-f19026112486 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:35.903934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802270-d0a7-4698-b621-f19026112486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:35.905551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1b802270-d0a7-4698-b621-f19026112486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:36.025485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b802270-d0a7-4698-b621-f19026112486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:36.026817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b802270-d0a7-4698-b621-f19026112486 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:36.045494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 745/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:38.240411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c612-72b2-44bd-a14d-42ce483dff95 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:38.241347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c612-72b2-44bd-a14d-42ce483dff95 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:38.241347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029c612-72b2-44bd-a14d-42ce483dff95 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:38.243509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:38.252708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ccb8-9cda-4a47-8384-dfacbab96fdd None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:38.253470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ccb8-9cda-4a47-8384-dfacbab96fdd None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:38.253629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5ccb8-9cda-4a47-8384-dfacbab96fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:38.324575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f9d5ccb8-9cda-4a47-8384-dfacbab96fdd None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:38.325796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f9d5ccb8-9cda-4a47-8384-dfacbab96fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:38.344307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:38.428219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:23:38.713672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029c612-72b2-44bd-a14d-42ce483dff95 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:38.715273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f029c612-72b2-44bd-a14d-42ce483dff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:38.835357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029c612-72b2-44bd-a14d-42ce483dff95 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:38.907110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:38.914607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc6542-342a-42c7-bc29-32ec8850bdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:38.915217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6542-342a-42c7-bc29-32ec8850bdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:38.915495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6542-342a-42c7-bc29-32ec8850bdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:38.915775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6542-342a-42c7-bc29-32ec8850bdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:38.917382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cbdc6542-342a-42c7-bc29-32ec8850bdd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:39.036447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc6542-342a-42c7-bc29-32ec8850bdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:39.037897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc6542-342a-42c7-bc29-32ec8850bdd1 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:39.181482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 721/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:41.369299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a585697-5983-4d24-a527-085f641074e0 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:41.369915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a585697-5983-4d24-a527-085f641074e0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:41.369915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a585697-5983-4d24-a527-085f641074e0 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:41.371184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:23:41.376885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f21b3-dac4-4bf9-ba76-d3b14315c41c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:41.377325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f21b3-dac4-4bf9-ba76-d3b14315c41c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:41.377325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f21b3-dac4-4bf9-ba76-d3b14315c41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:41.449829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-543f21b3-dac4-4bf9-ba76-d3b14315c41c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:23:41.451058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-543f21b3-dac4-4bf9-ba76-d3b14315c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:41.503392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:41.561329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:23:41.864645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a585697-5983-4d24-a527-085f641074e0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:23:41.867064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6a585697-5983-4d24-a527-085f641074e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:41.990934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a585697-5983-4d24-a527-085f641074e0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:23:42.046745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:42.082000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac881439-16ae-455d-9e7d-3e24bfc5a89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:23:42.082613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac881439-16ae-455d-9e7d-3e24bfc5a89c service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:23:42.082914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac881439-16ae-455d-9e7d-3e24bfc5a89c service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:23:42.083287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac881439-16ae-455d-9e7d-3e24bfc5a89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:23:42.084925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ac881439-16ae-455d-9e7d-3e24bfc5a89c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:23:42.196722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac881439-16ae-455d-9e7d-3e24bfc5a89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:23:42.198146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac881439-16ae-455d-9e7d-3e24bfc5a89c service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:23:42.219796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 748/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:23:51.559924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=22 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:23:52.217433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=66 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:02.233360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486898-e215-4a1d-8634-91ab2e3cbb87 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:02.233955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486898-e215-4a1d-8634-91ab2e3cbb87 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:02.233955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486898-e215-4a1d-8634-91ab2e3cbb87 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:02.235279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 723/1471] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:02.241011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d3a5-7fc2-4a4f-8a4c-48bb02801f49 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:02.241492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d3a5-7fc2-4a4f-8a4c-48bb02801f49 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:02.241597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055d3a5-7fc2-4a4f-8a4c-48bb02801f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:02.321057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f055d3a5-7fc2-4a4f-8a4c-48bb02801f49 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:02.322381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f055d3a5-7fc2-4a4f-8a4c-48bb02801f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:02.429695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 749/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:24:02.725966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c059c6-9129-4e34-99ab-6b7f57d4cbbb None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:02.726247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c059c6-9129-4e34-99ab-6b7f57d4cbbb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:02.726514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c059c6-9129-4e34-99ab-6b7f57d4cbbb None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:02.728042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 724/1473] 10.222.0.18 () {54 vars in 962 bytes} [Mon Sep 26 05:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:02.733824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5d6d-40fe-41ea-90b3-a1309d3f38f9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:02.734226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5d6d-40fe-41ea-90b3-a1309d3f38f9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:02.734613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b5d6d-40fe-41ea-90b3-a1309d3f38f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:02.820915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e62b5d6d-40fe-41ea-90b3-a1309d3f38f9 None None] MFA Rules not processed for user `1d78fc219a25457ca11e38930b03e8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:02.822417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e62b5d6d-40fe-41ea-90b3-a1309d3f38f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:02.845484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:02.908013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 750/1474] 10.222.0.18 () {58 vars in 1059 bytes} [Mon Sep 26 05:24:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:24:02.916242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c059c6-9129-4e34-99ab-6b7f57d4cbbb None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:24:02.917811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-12c059c6-9129-4e34-99ab-6b7f57d4cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:03.034177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c059c6-9129-4e34-99ab-6b7f57d4cbbb None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:24:03.112765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747db92-f3f9-4003-ae42-7839bb1a5b0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78fc219a25457ca11e38930b03e8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:24:03.113364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747db92-f3f9-4003-ae42-7839bb1a5b0d service glance] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:03.113636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747db92-f3f9-4003-ae42-7839bb1a5b0d service glance] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:03.113903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747db92-f3f9-4003-ae42-7839bb1a5b0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:03.115483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b747db92-f3f9-4003-ae42-7839bb1a5b0d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:03.172814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:03.231913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747db92-f3f9-4003-ae42-7839bb1a5b0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:24:03.233356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747db92-f3f9-4003-ae42-7839bb1a5b0d service glance] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:24:03.252468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 725/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:24:05.498805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4b7a-f46b-4322-bdcf-162f7c6f63f5 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:05.499394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4b7a-f46b-4322-bdcf-162f7c6f63f5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:05.499394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a4b7a-f46b-4322-bdcf-162f7c6f63f5 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:05.500673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 751/1476] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:05.507218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9422-d2d5-4f0e-a13d-17af1d57bc14 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:05.507777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9422-d2d5-4f0e-a13d-17af1d57bc14 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:05.507870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc9422-d2d5-4f0e-a13d-17af1d57bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:05.582945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-eafc9422-d2d5-4f0e-a13d-17af1d57bc14 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:05.584183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eafc9422-d2d5-4f0e-a13d-17af1d57bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:05.685657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 726/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:24:05.969879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a4b7a-f46b-4322-bdcf-162f7c6f63f5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:24:05.971447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-140a4b7a-f46b-4322-bdcf-162f7c6f63f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:06.123133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a4b7a-f46b-4322-bdcf-162f7c6f63f5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:24:06.176216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:06.222204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0f7b0-5dc6-410f-8ece-ba7663407cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:24:06.222743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f7b0-5dc6-410f-8ece-ba7663407cdd admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:06.223014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f7b0-5dc6-410f-8ece-ba7663407cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:06.223285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f7b0-5dc6-410f-8ece-ba7663407cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:06.223957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0f7b0-5dc6-410f-8ece-ba7663407cdd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:24:06.225688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-34e0f7b0-5dc6-410f-8ece-ba7663407cdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:24:06.225688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:24:06.225688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:24:06.226838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0f7b0-5dc6-410f-8ece-ba7663407cdd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:24:06.246689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 752/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Mon Sep 26 05:24:05 2022] GET /identity/v3/projects => generated 2553 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:24:08.454804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067826b-bf67-41c6-8b18-9386943bcf99 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:08.455400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067826b-bf67-41c6-8b18-9386943bcf99 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:08.455400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067826b-bf67-41c6-8b18-9386943bcf99 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:08.457428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 727/1479] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:08.464981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d4ff-0206-4679-91cd-44004576c186 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:08.465387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d4ff-0206-4679-91cd-44004576c186 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:08.465578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07d4ff-0206-4679-91cd-44004576c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:08.535177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-aa07d4ff-0206-4679-91cd-44004576c186 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:08.536525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-aa07d4ff-0206-4679-91cd-44004576c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:08.635465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 753/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:24:08.934016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067826b-bf67-41c6-8b18-9386943bcf99 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:24:08.936567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6067826b-bf67-41c6-8b18-9386943bcf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:08.950154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:09.092964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067826b-bf67-41c6-8b18-9386943bcf99 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:24:09.177013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:09.213331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543aa72-1694-4f55-8d73-b18644156439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:24:09.213941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543aa72-1694-4f55-8d73-b18644156439 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:09.214219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543aa72-1694-4f55-8d73-b18644156439 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:09.214493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543aa72-1694-4f55-8d73-b18644156439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:09.216131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b543aa72-1694-4f55-8d73-b18644156439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:09.321169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543aa72-1694-4f55-8d73-b18644156439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:24:09.323084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543aa72-1694-4f55-8d73-b18644156439 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:24:09.343248 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 728/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:24:11.676785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c6e24-8345-4aac-94fe-c5cf68e7806b None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:11.677336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c6e24-8345-4aac-94fe-c5cf68e7806b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:11.677336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c6e24-8345-4aac-94fe-c5cf68e7806b None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:11.678591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 754/1482] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:11.685761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69452b-9b63-4efc-8513-6edba689fc1d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:11.686504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69452b-9b63-4efc-8513-6edba689fc1d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:11.686710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69452b-9b63-4efc-8513-6edba689fc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:11.779651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5e69452b-9b63-4efc-8513-6edba689fc1d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:11.780890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5e69452b-9b63-4efc-8513-6edba689fc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:11.833495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:11.887042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 729/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:24:12.177927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c6e24-8345-4aac-94fe-c5cf68e7806b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:24:12.179534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-106c6e24-8345-4aac-94fe-c5cf68e7806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:12.205936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:12.295767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c6e24-8345-4aac-94fe-c5cf68e7806b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:24:12.377831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea6411-e217-4b23-b665-d25e8396336d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:24:12.378439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6411-e217-4b23-b665-d25e8396336d service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:12.378715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6411-e217-4b23-b665-d25e8396336d service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:12.378982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea6411-e217-4b23-b665-d25e8396336d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:12.380617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-95ea6411-e217-4b23-b665-d25e8396336d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:12.469963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:12.506351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6411-e217-4b23-b665-d25e8396336d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:24:12.507839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea6411-e217-4b23-b665-d25e8396336d service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:24:12.526231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 755/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:24:14.768087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2c74-6ea2-4910-bc15-42325e6b5a8f None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:14.768744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2c74-6ea2-4910-bc15-42325e6b5a8f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:14.768744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e2c74-6ea2-4910-bc15-42325e6b5a8f None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:14.770746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 730/1485] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:24:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:14.779627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb01f-2bcb-45e1-be0b-db295dfb4dee None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:14.780077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb01f-2bcb-45e1-be0b-db295dfb4dee None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:14.780186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccb01f-2bcb-45e1-be0b-db295dfb4dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:14.859222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eaccb01f-2bcb-45e1-be0b-db295dfb4dee None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:14.860473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eaccb01f-2bcb-45e1-be0b-db295dfb4dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:14.968691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 756/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:24:15.257897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2c74-6ea2-4910-bc15-42325e6b5a8f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:24:15.260398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4c0e2c74-6ea2-4910-bc15-42325e6b5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:15.384721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e2c74-6ea2-4910-bc15-42325e6b5a8f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:24:15.461103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:15.462535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f0dd2-3b73-4ba9-8308-8db0ea5554ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:24:15.463091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f0dd2-3b73-4ba9-8308-8db0ea5554ec service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:15.463366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f0dd2-3b73-4ba9-8308-8db0ea5554ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:15.463720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f0dd2-3b73-4ba9-8308-8db0ea5554ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:15.465947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-648f0dd2-3b73-4ba9-8308-8db0ea5554ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:15.582894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f0dd2-3b73-4ba9-8308-8db0ea5554ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:24:15.584366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f0dd2-3b73-4ba9-8308-8db0ea5554ec service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:24:15.604435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 731/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:24:17.929911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604fc4-d06b-4ed3-b994-aea4c12bbb57 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:17.930606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604fc4-d06b-4ed3-b994-aea4c12bbb57 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:17.931623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24604fc4-d06b-4ed3-b994-aea4c12bbb57 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:17.934103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 757/1488] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:24:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:17.944207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874a06b-5ed5-4493-aac3-2a6493a0bd82 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:17.944875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874a06b-5ed5-4493-aac3-2a6493a0bd82 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:17.944875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874a06b-5ed5-4493-aac3-2a6493a0bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:18.014565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2874a06b-5ed5-4493-aac3-2a6493a0bd82 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:18.015799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2874a06b-5ed5-4493-aac3-2a6493a0bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:18.072769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:18.120758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 732/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:24:18.416753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604fc4-d06b-4ed3-b994-aea4c12bbb57 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:24:18.419183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-24604fc4-d06b-4ed3-b994-aea4c12bbb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:18.466980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:18.542495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24604fc4-d06b-4ed3-b994-aea4c12bbb57 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:24:18.621020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a2ae0-724b-4ff5-b979-2054e8276ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:24:18.621667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2ae0-724b-4ff5-b979-2054e8276ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:18.621941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2ae0-724b-4ff5-b979-2054e8276ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:18.622204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2ae0-724b-4ff5-b979-2054e8276ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:18.623855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-174a2ae0-724b-4ff5-b979-2054e8276ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:18.706587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:18.737488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2ae0-724b-4ff5-b979-2054e8276ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:24:18.738930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2ae0-724b-4ff5-b979-2054e8276ab7 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:24:18.759758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 758/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:24:21.207153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10c7d-d038-4c03-b144-1ae8df1e08af None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:21.208032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10c7d-d038-4c03-b144-1ae8df1e08af None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:21.208032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10c7d-d038-4c03-b144-1ae8df1e08af None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:21.210152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 733/1491] 10.222.0.18 () {54 vars in 927 bytes} [Mon Sep 26 05:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:24:21.216675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed2d3f-7688-4930-9d3a-9c40e1faf5c7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:21.217150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed2d3f-7688-4930-9d3a-9c40e1faf5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:21.217261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed2d3f-7688-4930-9d3a-9c40e1faf5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:21.285292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-33ed2d3f-7688-4930-9d3a-9c40e1faf5c7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:24:21.286508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-33ed2d3f-7688-4930-9d3a-9c40e1faf5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:21.390105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 759/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Mon Sep 26 05:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:24:21.713341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f10c7d-d038-4c03-b144-1ae8df1e08af None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:24:21.715846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-75f10c7d-d038-4c03-b144-1ae8df1e08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:21.842007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f10c7d-d038-4c03-b144-1ae8df1e08af None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:24:21.921965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8930c1e-7e37-4d12-a673-1a4dc329c103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:24:21.922767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8930c1e-7e37-4d12-a673-1a4dc329c103 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:24:21.923011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8930c1e-7e37-4d12-a673-1a4dc329c103 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:24:21.923284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8930c1e-7e37-4d12-a673-1a4dc329c103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:24:21.924975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a8930c1e-7e37-4d12-a673-1a4dc329c103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:24:21.935909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:22.055692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8930c1e-7e37-4d12-a673-1a4dc329c103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:24:22.057712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8930c1e-7e37-4d12-a673-1a4dc329c103 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:24:22.076955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 734/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:24:31.388568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=82 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:24:32.074555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=50 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:37.167697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:37.168333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:37.168333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:37.259146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:25:37.260442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:37.362010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 760/1494] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:25:37.371061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4a7f-5a69-4bb6-8a23-31a41f1df88d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:37.371628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4a7f-5a69-4bb6-8a23-31a41f1df88d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:37.371628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4a7f-5a69-4bb6-8a23-31a41f1df88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:37.472757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-23ed4a7f-5a69-4bb6-8a23-31a41f1df88d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:25:37.473879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-23ed4a7f-5a69-4bb6-8a23-31a41f1df88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:37.577424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 735/1495] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:25:37.582418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:37.583788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:37.595909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cd00f-688c-4bb5-9bc5-373430769141 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:37.662482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:37.711456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:37.712174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:37.712450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:37.712724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:37.713370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:25:37.713678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:37.714664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:37.714664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:25:37.714664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:25:37.715595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:37.727312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 761/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:25:37.735967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed4a7f-5a69-4bb6-8a23-31a41f1df88d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:37.745422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed4a7f-5a69-4bb6-8a23-31a41f1df88d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:37.810525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:37.855533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:37.856166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:37.856438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:37.856702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:37.857328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:37.859095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:37.859095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 26 05:25:37.859095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: Sep 26 05:25:37.860310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:37.927399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 736/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:25:37 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:25:37.933508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:37.935836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:37.971973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5686f1-3fa9-4e97-9095-3e22c538b610 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:38.068333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:38.068849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:38.069123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:38.069400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:38.070041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:38.071042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:38.071042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:25:38.071042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:25:38.072296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:38.120905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 762/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:25:37 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:25:38.125267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:38.126789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:38.191471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7cc1c-ae7a-44e0-aeb6-9896be53cc0b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:38.291080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:38.303741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:38.304378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:38.304649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:38.304915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:38.305712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:38.306717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:38.306717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 26 05:25:38.306717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: Sep 26 05:25:38.308076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:38.320942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 737/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:25:38.325638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:38.327219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:38.339435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b48b6-a3f6-4420-9c75-c66e024bcfd5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:38.366325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:38.446773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b61dfa-7cac-4521-be07-1d331a4af32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:38.447479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b61dfa-7cac-4521-be07-1d331a4af32b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:38.447791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b61dfa-7cac-4521-be07-1d331a4af32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:38.448060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b61dfa-7cac-4521-be07-1d331a4af32b admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:38.448704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b61dfa-7cac-4521-be07-1d331a4af32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:38.449723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-61b61dfa-7cac-4521-be07-1d331a4af32b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:38.449723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:25:38.449723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:25:38.450613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b61dfa-7cac-4521-be07-1d331a4af32b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:38.463364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 763/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:25:38.469522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:38.471094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:38.512277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514e669-5daf-4afe-a72c-2fdc451b1c5c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:38.616328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31dd8b-fe69-415a-b2d4-e87f973e4728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:38.617000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31dd8b-fe69-415a-b2d4-e87f973e4728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:38.617276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31dd8b-fe69-415a-b2d4-e87f973e4728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:38.617547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31dd8b-fe69-415a-b2d4-e87f973e4728 admin admin] PATH_INFO: `/v3/projects/486c3914e91d4deda77cc317c2365dcf/users/9d75e9ab892b4130b7c5b01b2bc5f807/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:38.643919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31dd8b-fe69-415a-b2d4-e87f973e4728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486c3914e91d4deda77cc317c2365dcf, user_id=9d75e9ab892b4130b7c5b01b2bc5f807, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:38.644972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-3b31dd8b-fe69-415a-b2d4-e87f973e4728 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:38.644972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 26 05:25:38.644972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: Sep 26 05:25:38.646928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31dd8b-fe69-415a-b2d4-e87f973e4728 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:38.675161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 738/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:25:38 2022] PUT /identity/v3/projects/486c3914e91d4deda77cc317c2365dcf/users/9d75e9ab892b4130b7c5b01b2bc5f807/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:25:38.688037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca80d-fd22-420b-b009-bfbd4c8ca9d6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:38.688321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca80d-fd22-420b-b009-bfbd4c8ca9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:38.688598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca80d-fd22-420b-b009-bfbd4c8ca9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:38.752840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-cd8ca80d-fd22-420b-b009-bfbd4c8ca9d6 None None] MFA Rules not processed for user `9d75e9ab892b4130b7c5b01b2bc5f807`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:25:38.754063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cd8ca80d-fd22-420b-b009-bfbd4c8ca9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:38.848960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 764/1502] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:25:38.862817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1937-a4be-4abf-9ba1-e470aabeb1ea None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:38.863101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1937-a4be-4abf-9ba1-e470aabeb1ea None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:38.863374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce1937-a4be-4abf-9ba1-e470aabeb1ea None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:38.864754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 739/1503] 10.222.0.18 () {54 vars in 963 bytes} [Mon Sep 26 05:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:25:38.869970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158574af-e816-4823-a379-b5f9c1b388a4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:38.870164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158574af-e816-4823-a379-b5f9c1b388a4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:38.870429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158574af-e816-4823-a379-b5f9c1b388a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:38.902596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:38.948029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-158574af-e816-4823-a379-b5f9c1b388a4 None None] MFA Rules not processed for user `262c0977be384e59a37ef91978012ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:25:38.949233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-158574af-e816-4823-a379-b5f9c1b388a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:39.029678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 765/1504] 10.222.0.18 () {58 vars in 1060 bytes} [Mon Sep 26 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:25:39.037888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1937-a4be-4abf-9ba1-e470aabeb1ea None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:39.039456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-05ce1937-a4be-4abf-9ba1-e470aabeb1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:39.104042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:39.161601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce1937-a4be-4abf-9ba1-e470aabeb1ea None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:39.241979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:39.242581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:39.242856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:39.243146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:39.244814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:39.354598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:39.356079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:39.359640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:39.374774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 740/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:25:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:25:39.428776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5433ca-20a4-48a2-8959-3730b9cf2fd4 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:39.429255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5433ca-20a4-48a2-8959-3730b9cf2fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:39.429361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5433ca-20a4-48a2-8959-3730b9cf2fd4 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:39.430632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 766/1506] 10.222.0.18 () {52 vars in 830 bytes} [Mon Sep 26 05:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:25:39.436727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:39.438603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:39.542563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9befb9-7a51-4864-af2b-5a3473fd90ec service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:39.641044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:39.641673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:39.641937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:39.642220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] PATH_INFO: `/v3/users/9d75e9ab892b4130b7c5b01b2bc5f807` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:39.655070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d75e9ab892b4130b7c5b01b2bc5f807)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:39.656138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:39.656138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 26 05:25:39.656138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: Sep 26 05:25:39.657356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:39.670355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:39.733596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d75e9ab892b4130b7c5b01b2bc5f807'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:39.745710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d75e9ab892b4130b7c5b01b2bc5f807'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:39.769490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d75e9ab892b4130b7c5b01b2bc5f807'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:39.769966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d75e9ab892b4130b7c5b01b2bc5f807'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:39.783977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d75e9ab892b4130b7c5b01b2bc5f807'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:39.789685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 741/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:25:39 2022] DELETE /identity/v3/users/9d75e9ab892b4130b7c5b01b2bc5f807 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:25:39.794363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:39.794673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:39.794914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:39.856013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:25:39.857222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:39.937988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:39.954792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 767/1508] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:25:39.964990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:39.966235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:40.076545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e3c6c-1f5e-47ca-9232-4246f32f87cd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:40.139230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:40.161374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83feb06e-351d-4e16-ac76-29a2b79b8b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:40.161991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb06e-351d-4e16-ac76-29a2b79b8b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:40.162263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb06e-351d-4e16-ac76-29a2b79b8b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:40.162529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83feb06e-351d-4e16-ac76-29a2b79b8b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:40.164180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-83feb06e-351d-4e16-ac76-29a2b79b8b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:40.287068 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feb06e-351d-4e16-ac76-29a2b79b8b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:40.288450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83feb06e-351d-4e16-ac76-29a2b79b8b99 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:40.309432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 742/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:25:40.673538 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:25:40.674868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:25:40.687332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1b708-a49a-48f2-a0e9-4a5e4f07335d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:25:40.791012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:25:40.791849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:25:40.792216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:25:40.792449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] PATH_INFO: `/v3/projects/486c3914e91d4deda77cc317c2365dcf` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:25:40.803112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486c3914e91d4deda77cc317c2365dcf)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:25:40.804185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:25:40.804185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:25:40.804185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:25:40.805389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:25:40.867697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486c3914e91d4deda77cc317c2365dcf', 'request_id': 'req-225b6e82-1962-4407-a951-6f76d5536193'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:40.882322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486c3914e91d4deda77cc317c2365dcf', 'request_id': 'req-225b6e82-1962-4407-a951-6f76d5536193'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:40.897507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486c3914e91d4deda77cc317c2365dcf', 'request_id': 'req-225b6e82-1962-4407-a951-6f76d5536193'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:40.924579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] The token cache is being invalidate because project 486c3914e91d4deda77cc317c2365dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:25:40.924843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:40.925290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-225b6e82-1962-4407-a951-6f76d5536193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:25:40.926732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 768/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:25:40 2022] DELETE /identity/v3/projects/486c3914e91d4deda77cc317c2365dcf => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:25:50.306287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=62 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:25:50.922098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:17.573169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00188-3102-47ab-ae51-f8fc764530aa None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:17.573770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00188-3102-47ab-ae51-f8fc764530aa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:17.573770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee00188-3102-47ab-ae51-f8fc764530aa None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:17.574942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:17.579989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434af874-a03d-4ee6-80e9-da8a1bfb8080 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:17.580441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434af874-a03d-4ee6-80e9-da8a1bfb8080 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:17.580581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434af874-a03d-4ee6-80e9-da8a1bfb8080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:17.668370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-434af874-a03d-4ee6-80e9-da8a1bfb8080 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:17.669561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-434af874-a03d-4ee6-80e9-da8a1bfb8080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:17.787996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:17.945871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee00188-3102-47ab-ae51-f8fc764530aa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:17.948414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bee00188-3102-47ab-ae51-f8fc764530aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:18.080192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee00188-3102-47ab-ae51-f8fc764530aa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:18.086916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d328eb8-4e6d-4be9-9596-b0b6803349ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:18.087531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328eb8-4e6d-4be9-9596-b0b6803349ba service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:18.087833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328eb8-4e6d-4be9-9596-b0b6803349ba service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:18.088119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d328eb8-4e6d-4be9-9596-b0b6803349ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:18.097332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d328eb8-4e6d-4be9-9596-b0b6803349ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:18.099091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d328eb8-4e6d-4be9-9596-b0b6803349ba service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:18.109120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 744/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:19.188089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2a545-9ed9-42ea-9eee-43386eb24d0c None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:19.188978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2a545-9ed9-42ea-9eee-43386eb24d0c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:19.188978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2a545-9ed9-42ea-9eee-43386eb24d0c None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:19.191191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:27:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:19.197789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd371b6-42b9-4a7e-bf63-fc14efb967e2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:19.198239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd371b6-42b9-4a7e-bf63-fc14efb967e2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:19.198347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd371b6-42b9-4a7e-bf63-fc14efb967e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:19.219846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2cd371b6-42b9-4a7e-bf63-fc14efb967e2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:19.221053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2cd371b6-42b9-4a7e-bf63-fc14efb967e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:19.229836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:19.387174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2a545-9ed9-42ea-9eee-43386eb24d0c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:19.404934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2a545-9ed9-42ea-9eee-43386eb24d0c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:19.413148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5139c-fd5d-4d94-9178-f338aa703cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:19.414030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5139c-fd5d-4d94-9178-f338aa703cb6 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:19.414308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5139c-fd5d-4d94-9178-f338aa703cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:19.414682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5139c-fd5d-4d94-9178-f338aa703cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:19.427967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5139c-fd5d-4d94-9178-f338aa703cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:19.429688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede5139c-fd5d-4d94-9178-f338aa703cb6 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:19.440655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 771/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:19.460269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789895c-73a3-40f4-9a73-241e7f6a4cb7 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:19.460559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789895c-73a3-40f4-9a73-241e7f6a4cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:19.460855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789895c-73a3-40f4-9a73-241e7f6a4cb7 None None] PATH_INFO: `/v3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:19.462112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 746/1517] 10.222.0.48 () {54 vars in 925 bytes} [Mon Sep 26 05:27:19 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:27:19.468567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da66009-ce3b-4e3a-9682-248cfca5e5f5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:19.468862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da66009-ce3b-4e3a-9682-248cfca5e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:19.469122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da66009-ce3b-4e3a-9682-248cfca5e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:19.544111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1da66009-ce3b-4e3a-9682-248cfca5e5f5 None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:19.545570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1da66009-ce3b-4e3a-9682-248cfca5e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:19.566511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:19.626661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 772/1518] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Sep 26 05:27:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:28.471706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033e093-1f77-4451-b96e-251aaa47d547 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:28.472234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033e093-1f77-4451-b96e-251aaa47d547 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:28.472234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033e093-1f77-4451-b96e-251aaa47d547 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:28.473557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 747/1519] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 05:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:28.478826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191aaa-66f7-4100-bd51-52b7d1a090f2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:28.479305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191aaa-66f7-4100-bd51-52b7d1a090f2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:28.479412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191aaa-66f7-4100-bd51-52b7d1a090f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:28.499481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-22191aaa-66f7-4100-bd51-52b7d1a090f2 None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:28.500695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-22191aaa-66f7-4100-bd51-52b7d1a090f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:28.509876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 773/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 05:27:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:28.517673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033e093-1f77-4451-b96e-251aaa47d547 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:28.532347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033e093-1f77-4451-b96e-251aaa47d547 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:28.537706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cc6a21-cfc9-4a9f-8c76-4634451bfb6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:28.539343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6a21-cfc9-4a9f-8c76-4634451bfb6c service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:28.539648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6a21-cfc9-4a9f-8c76-4634451bfb6c service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:28.540097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc6a21-cfc9-4a9f-8c76-4634451bfb6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:28.548958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc6a21-cfc9-4a9f-8c76-4634451bfb6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:28.550551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cc6a21-cfc9-4a9f-8c76-4634451bfb6c service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:28.561541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 748/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:30.962291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4de3c-9114-491f-b803-2c48308cfc64 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:30.962926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4de3c-9114-491f-b803-2c48308cfc64 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:30.962926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4de3c-9114-491f-b803-2c48308cfc64 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:30.964197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:30.971942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6be20-669d-44ed-819d-94522aa71986 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:30.972734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6be20-669d-44ed-819d-94522aa71986 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:30.972852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6be20-669d-44ed-819d-94522aa71986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:30.994062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9ee6be20-669d-44ed-819d-94522aa71986 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:30.995279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9ee6be20-669d-44ed-819d-94522aa71986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:31.003273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:31.173754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4de3c-9114-491f-b803-2c48308cfc64 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:31.191350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4de3c-9114-491f-b803-2c48308cfc64 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:31.197528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10ce73-e7c6-497f-a7c9-3f56befe2416 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:31.198131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ce73-e7c6-497f-a7c9-3f56befe2416 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:31.198408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ce73-e7c6-497f-a7c9-3f56befe2416 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:31.198681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10ce73-e7c6-497f-a7c9-3f56befe2416 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:31.207314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10ce73-e7c6-497f-a7c9-3f56befe2416 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:31.208948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10ce73-e7c6-497f-a7c9-3f56befe2416 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:31.219934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 775/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:32.312766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2bbc-d261-4a86-8941-bb9e4a1acbd4 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:32.313346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2bbc-d261-4a86-8941-bb9e4a1acbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:32.313346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da2bbc-d261-4a86-8941-bb9e4a1acbd4 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:32.314653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:32.322224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fd9f2-4c95-42d3-99f1-2b22b693c100 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:32.322692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fd9f2-4c95-42d3-99f1-2b22b693c100 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:32.322802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55fd9f2-4c95-42d3-99f1-2b22b693c100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:32.346668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b55fd9f2-4c95-42d3-99f1-2b22b693c100 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:32.347895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b55fd9f2-4c95-42d3-99f1-2b22b693c100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:32.359940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:32.518256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2bbc-d261-4a86-8941-bb9e4a1acbd4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:32.542028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da2bbc-d261-4a86-8941-bb9e4a1acbd4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:32.547946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326e1a5-7035-4736-84a1-d1cf6b04d905 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:32.548545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e1a5-7035-4736-84a1-d1cf6b04d905 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:32.548835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e1a5-7035-4736-84a1-d1cf6b04d905 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:32.549095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326e1a5-7035-4736-84a1-d1cf6b04d905 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:32.558058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326e1a5-7035-4736-84a1-d1cf6b04d905 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:32.559687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326e1a5-7035-4736-84a1-d1cf6b04d905 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:32.569529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 751/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:36.546488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5bf38-5b76-4df2-b68b-6685584254d6 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:36.547035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5bf38-5b76-4df2-b68b-6685584254d6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:36.547035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5bf38-5b76-4df2-b68b-6685584254d6 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:36.548326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:36.554849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3b5fd-a20c-4776-a306-796950e86ad9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:36.555367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3b5fd-a20c-4776-a306-796950e86ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:36.555367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3b5fd-a20c-4776-a306-796950e86ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:36.576479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-afe3b5fd-a20c-4776-a306-796950e86ad9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:36.577660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-afe3b5fd-a20c-4776-a306-796950e86ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:36.586396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:36.871970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5bf38-5b76-4df2-b68b-6685584254d6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:36.875284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-04a5bf38-5b76-4df2-b68b-6685584254d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:36.959672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5bf38-5b76-4df2-b68b-6685584254d6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:36.963785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879e156-b64c-4442-a0e1-e6e9927b7a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:36.964392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e156-b64c-4442-a0e1-e6e9927b7a63 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:36.964672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e156-b64c-4442-a0e1-e6e9927b7a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:36.964945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879e156-b64c-4442-a0e1-e6e9927b7a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:36.975227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e156-b64c-4442-a0e1-e6e9927b7a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:36.976788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879e156-b64c-4442-a0e1-e6e9927b7a63 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:36.986411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 778/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:39.113125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044bce-03eb-43b5-a7e7-e22bdb217bab None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:39.113855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044bce-03eb-43b5-a7e7-e22bdb217bab None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:39.113855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044bce-03eb-43b5-a7e7-e22bdb217bab None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:39.115148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:39.121836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708aa2f-49f9-44e3-82c9-fc36eadc0617 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:39.122253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708aa2f-49f9-44e3-82c9-fc36eadc0617 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:39.122531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708aa2f-49f9-44e3-82c9-fc36eadc0617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:39.146445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0708aa2f-49f9-44e3-82c9-fc36eadc0617 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:39.147717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0708aa2f-49f9-44e3-82c9-fc36eadc0617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:39.157281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:39.451214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02044bce-03eb-43b5-a7e7-e22bdb217bab None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:39.467396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02044bce-03eb-43b5-a7e7-e22bdb217bab None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:39.471900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789089bc-03a7-4b94-b3e5-256a2ae2ea20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:39.472499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789089bc-03a7-4b94-b3e5-256a2ae2ea20 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:39.472773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789089bc-03a7-4b94-b3e5-256a2ae2ea20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:39.473041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789089bc-03a7-4b94-b3e5-256a2ae2ea20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:39.483057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789089bc-03a7-4b94-b3e5-256a2ae2ea20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:39.484533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789089bc-03a7-4b94-b3e5-256a2ae2ea20 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:39.495008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 754/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:43.191220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154504-b675-499f-b60d-cd2c08957e7d None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:43.191832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154504-b675-499f-b60d-cd2c08957e7d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:43.191832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154504-b675-499f-b60d-cd2c08957e7d None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:43.193166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:43.199597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033940-9f6f-421d-b83f-212053f94792 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:43.200311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033940-9f6f-421d-b83f-212053f94792 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:43.200488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033940-9f6f-421d-b83f-212053f94792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:43.212727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=81 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:43.227365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1a033940-9f6f-421d-b83f-212053f94792 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:43.228611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1a033940-9f6f-421d-b83f-212053f94792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:43.237120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:43.540844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154504-b675-499f-b60d-cd2c08957e7d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:43.542958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-70154504-b675-499f-b60d-cd2c08957e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:43.619453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:43.634919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154504-b675-499f-b60d-cd2c08957e7d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:43.638950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8e5e6-767f-4d9e-9acd-a309351d7ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:43.639581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e5e6-767f-4d9e-9acd-a309351d7ede service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:43.639851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e5e6-767f-4d9e-9acd-a309351d7ede service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:43.640126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8e5e6-767f-4d9e-9acd-a309351d7ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:43.650049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8e5e6-767f-4d9e-9acd-a309351d7ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:43.651520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8e5e6-767f-4d9e-9acd-a309351d7ede service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:43.661287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 781/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:45.873498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f689337-caaf-4fcd-a02e-0816ace172ce None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:45.874417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f689337-caaf-4fcd-a02e-0816ace172ce None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:45.874417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f689337-caaf-4fcd-a02e-0816ace172ce None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:45.876477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:27:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:27:45.884541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4945f9-61af-4128-b0bd-5373a3e40b05 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:45.885008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4945f9-61af-4128-b0bd-5373a3e40b05 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:45.885111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4945f9-61af-4128-b0bd-5373a3e40b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:45.906071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7f4945f9-61af-4128-b0bd-5373a3e40b05 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:27:45.907255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7f4945f9-61af-4128-b0bd-5373a3e40b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:45.916837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:27:46.215976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f689337-caaf-4fcd-a02e-0816ace172ce None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:27:46.218001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7f689337-caaf-4fcd-a02e-0816ace172ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:27:46.234941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f689337-caaf-4fcd-a02e-0816ace172ce None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:27:46.241370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515d140-daf8-49ad-bcd1-6eb997aa4613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:27:46.242316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515d140-daf8-49ad-bcd1-6eb997aa4613 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:27:46.242590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515d140-daf8-49ad-bcd1-6eb997aa4613 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:27:46.242857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515d140-daf8-49ad-bcd1-6eb997aa4613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:27:46.252335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515d140-daf8-49ad-bcd1-6eb997aa4613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:27:46.253770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515d140-daf8-49ad-bcd1-6eb997aa4613 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:27:46.263888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 757/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:27:55.900953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=11 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:27:56.259435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=8 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:18.379498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596595a6-0bdf-44f9-a21b-33e7c1f3a402 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.380187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596595a6-0bdf-44f9-a21b-33e7c1f3a402 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.380187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596595a6-0bdf-44f9-a21b-33e7c1f3a402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.405068 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffc3f2-e4ee-439e-8b18-bdf36889a451 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.406117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffc3f2-e4ee-439e-8b18-bdf36889a451 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.408229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edffc3f2-e4ee-439e-8b18-bdf36889a451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.408362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-596595a6-0bdf-44f9-a21b-33e7c1f3a402 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.409506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-596595a6-0bdf-44f9-a21b-33e7c1f3a402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.426478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 783/1540] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.435942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-edffc3f2-e4ee-439e-8b18-bdf36889a451 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.437616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-edffc3f2-e4ee-439e-8b18-bdf36889a451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.445317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89916-74e4-4a5b-9f56-51d85576fae3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.445833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89916-74e4-4a5b-9f56-51d85576fae3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.446375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c89916-74e4-4a5b-9f56-51d85576fae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.455200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 758/1541] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.471203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd122a0-c817-4b37-82ed-e0634c5f95e9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.471894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd122a0-c817-4b37-82ed-e0634c5f95e9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.472399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd122a0-c817-4b37-82ed-e0634c5f95e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.476392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e5c89916-74e4-4a5b-9f56-51d85576fae3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.477571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e5c89916-74e4-4a5b-9f56-51d85576fae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.500468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6bd122a0-c817-4b37-82ed-e0634c5f95e9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.501528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 784/1542] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:18.502202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6bd122a0-c817-4b37-82ed-e0634c5f95e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.503273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ce4d-b1b4-451b-a8c8-6cc4adf215b0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.503913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ce4d-b1b4-451b-a8c8-6cc4adf215b0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.504468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13ce4d-b1b4-451b-a8c8-6cc4adf215b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.522013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 759/1543] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:18.523418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef5f5-5dd7-4348-b8b9-cbd68125e2d6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.523801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef5f5-5dd7-4348-b8b9-cbd68125e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.524080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ef5f5-5dd7-4348-b8b9-cbd68125e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.533133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2b13ce4d-b1b4-451b-a8c8-6cc4adf215b0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.534343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2b13ce4d-b1b4-451b-a8c8-6cc4adf215b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.543689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 785/1544] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.544450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13ce4d-b1b4-451b-a8c8-6cc4adf215b0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.553238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f70ef5f5-5dd7-4348-b8b9-cbd68125e2d6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.554676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13ce4d-b1b4-451b-a8c8-6cc4adf215b0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.554818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f70ef5f5-5dd7-4348-b8b9-cbd68125e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.561549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a226c31-1d53-4b6b-89cb-594da31ff9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.562124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226c31-1d53-4b6b-89cb-594da31ff9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.562398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226c31-1d53-4b6b-89cb-594da31ff9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.562888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a226c31-1d53-4b6b-89cb-594da31ff9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.563571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a226c31-1d53-4b6b-89cb-594da31ff9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:18.563943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a226c31-1d53-4b6b-89cb-594da31ff9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.564151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 760/1545] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.565386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82a47-f55d-4aed-a811-ce75c777aef8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.565619 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a226c31-1d53-4b6b-89cb-594da31ff9b4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.565739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82a47-f55d-4aed-a811-ce75c777aef8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.565928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b82a47-f55d-4aed-a811-ce75c777aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.579943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 786/1546] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.581623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305138c-2a34-4454-862f-b5ea407f0343 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.581911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305138c-2a34-4454-862f-b5ea407f0343 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.582460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305138c-2a34-4454-862f-b5ea407f0343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.586306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f3b82a47-f55d-4aed-a811-ce75c777aef8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.587639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f3b82a47-f55d-4aed-a811-ce75c777aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.596443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 761/1547] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.597682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f52b-2ee2-44c2-9463-2f77bb5c82e7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.597972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f52b-2ee2-44c2-9463-2f77bb5c82e7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.598243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632f52b-2ee2-44c2-9463-2f77bb5c82e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.603651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9305138c-2a34-4454-862f-b5ea407f0343 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.605145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9305138c-2a34-4454-862f-b5ea407f0343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.613380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 787/1548] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.614164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305138c-2a34-4454-862f-b5ea407f0343 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.617712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3632f52b-2ee2-44c2-9463-2f77bb5c82e7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.618902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3632f52b-2ee2-44c2-9463-2f77bb5c82e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.623461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305138c-2a34-4454-862f-b5ea407f0343 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.627093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 762/1549] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.628060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db88a91-f4dc-4a5e-90ae-851358eb8de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.628315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aed45-f4e4-4774-a263-e7c41c050521 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.628600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aed45-f4e4-4774-a263-e7c41c050521 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.628710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88a91-f4dc-4a5e-90ae-851358eb8de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.628869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011aed45-f4e4-4774-a263-e7c41c050521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.628991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88a91-f4dc-4a5e-90ae-851358eb8de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.629171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db88a91-f4dc-4a5e-90ae-851358eb8de7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.629816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88a91-f4dc-4a5e-90ae-851358eb8de7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:18.630145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88a91-f4dc-4a5e-90ae-851358eb8de7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.631813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db88a91-f4dc-4a5e-90ae-851358eb8de7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.646790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 788/1550] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.646790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3c5b-1a8f-4297-8af8-bf1d2e677939 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.646790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3c5b-1a8f-4297-8af8-bf1d2e677939 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.646790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be3c5b-1a8f-4297-8af8-bf1d2e677939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.647674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-011aed45-f4e4-4774-a263-e7c41c050521 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.648872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-011aed45-f4e4-4774-a263-e7c41c050521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.657417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 763/1551] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.658493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4a21-9296-4855-b1a0-13bda51e80d5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.658779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4a21-9296-4855-b1a0-13bda51e80d5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.659054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d4a21-9296-4855-b1a0-13bda51e80d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.669891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e5be3c5b-1a8f-4297-8af8-bf1d2e677939 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.671316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e5be3c5b-1a8f-4297-8af8-bf1d2e677939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.679343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 789/1552] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.680498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be3c5b-1a8f-4297-8af8-bf1d2e677939 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.682213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c14d4a21-9296-4855-b1a0-13bda51e80d5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.683724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c14d4a21-9296-4855-b1a0-13bda51e80d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.690321 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be3c5b-1a8f-4297-8af8-bf1d2e677939 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.691979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 764/1553] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.693168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36cec-94dd-41e9-a75f-c22b9d49bf59 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.693453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36cec-94dd-41e9-a75f-c22b9d49bf59 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.693730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d36cec-94dd-41e9-a75f-c22b9d49bf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.699527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.700187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.700463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.700730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.701410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.702531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:29:18.702531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:29:18.702531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:29:18.703775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.713346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c6d36cec-94dd-41e9-a75f-c22b9d49bf59 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.714548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c6d36cec-94dd-41e9-a75f-c22b9d49bf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.722540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 765/1554] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.723525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f7edd-0707-4c59-9bbf-df966c00a57c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.723973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f7edd-0707-4c59-9bbf-df966c00a57c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.724248 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f7edd-0707-4c59-9bbf-df966c00a57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.743691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1d8f7edd-0707-4c59-9bbf-df966c00a57c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.744891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1d8f7edd-0707-4c59-9bbf-df966c00a57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.746098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 790/1555] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:18.746098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.806824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 766/1556] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.807573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f7edd-0707-4c59-9bbf-df966c00a57c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.816830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8125a1c8-cbd1-4786-8f2e-f3f188ac8a85 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.817095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f7edd-0707-4c59-9bbf-df966c00a57c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.821376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce697c03-9072-478b-b18f-48d8a1702fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.821832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.821962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce697c03-9072-478b-b18f-48d8a1702fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.822243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce697c03-9072-478b-b18f-48d8a1702fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.822462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.822568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce697c03-9072-478b-b18f-48d8a1702fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.822746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.823047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.823175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce697c03-9072-478b-b18f-48d8a1702fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:18.823423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce697c03-9072-478b-b18f-48d8a1702fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.823775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.825062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce697c03-9072-478b-b18f-48d8a1702fe1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.826416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.837218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 791/1557] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.838792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85e755-60af-49ca-8ac2-553e450b0640 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.839076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85e755-60af-49ca-8ac2-553e450b0640 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.839348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85e755-60af-49ca-8ac2-553e450b0640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.860017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fb85e755-60af-49ca-8ac2-553e450b0640 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.861176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 767/1558] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:18.861290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fb85e755-60af-49ca-8ac2-553e450b0640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.862031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.924835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 792/1559] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.926099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72efe-67bd-4c49-822e-b1806b0df7e5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.926377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72efe-67bd-4c49-822e-b1806b0df7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.926754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf72efe-67bd-4c49-822e-b1806b0df7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.929259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04ab14-cc46-4d0d-b36a-fd65b6ff851a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.934784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.935437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.935770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.936167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.936301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:18.936744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:18.937048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.938080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:29:18.938080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 26 05:29:18.938080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: Sep 26 05:29:18.938970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.947620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ebf72efe-67bd-4c49-822e-b1806b0df7e5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:18.948948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ebf72efe-67bd-4c49-822e-b1806b0df7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:18.951496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 768/1560] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.952352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.957627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 793/1561] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:18.958695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf72efe-67bd-4c49-822e-b1806b0df7e5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.965713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1b37-f3e1-480e-ac0f-9036987ce968 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.969176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf72efe-67bd-4c49-822e-b1806b0df7e5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.971198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.971819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.972091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.972354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.972989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:18.973283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.973600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.974194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.974473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.974788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.974947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.975364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.977289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.990880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 769/1562] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.992127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.001853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 794/1563] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:18 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.002791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.003150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa321452-7ff8-4c9c-a766-12ae06a7e29e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.007647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.008246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.008520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.008793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.009431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:19.009857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.011447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.013059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:19.014118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f7a0e-17b2-4732-9bed-4116986d457d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.019862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.020679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.020885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.021158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.021839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.023809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.025762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 770/1564] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:19.026550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.043207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224f7d0-904f-4548-b988-5fd65e690c30 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.048771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.049397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.049642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.049912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.050533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.051595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:29:19.051595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 26 05:29:19.051595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: Sep 26 05:29:19.052791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.059347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 795/1565] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.059347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.076345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 771/1566] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/users => generated 288 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.077467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.087964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53560e-ef74-4562-ace7-39ab652c53e9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.129116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cde26-c7a4-4043-9f4e-a0975a07267f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.133645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.134256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.134532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.134804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.135474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:19.135776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.137371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.145248 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.145864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.146143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.146413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.147044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.148980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.149325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 796/1567] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:19.150116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.162128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac9d41-38b4-4706-bb54-50b8f6b5772f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.169126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.170314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.170834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.171322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.172770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:19.173211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.175910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.182692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 772/1568] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.183578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.189471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 797/1569] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:19.190365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.204290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe8f1b-30bb-43c1-8018-9188f6da1229 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.254998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5f694-73c5-4fe4-887d-39e6c1e6bd5b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.259567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.260177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.260318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.260427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.260700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.260813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.261052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.261325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.261430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.261972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.263221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.263613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.276587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 798/1570] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.276587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.284835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c047dd3c-a71e-4497-89d7-37390eb4a525 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.289852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.290541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.290920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.291294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.292209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.297016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 773/1571] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.297189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.297288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.329558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 799/1572] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.329558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.340457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:19.344949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:19.360889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15ae2-ba83-4399-a902-488c47b80be0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.390773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f348d-2af1-4428-a5de-ce0abebb0563 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.395778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.396421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.396704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.396977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.397655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.399270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.409558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 800/1573] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.410359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.419829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e5c1-9aa7-4139-9e72-f14c50b7dca5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.421878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.422496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.422763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.423029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.423714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.424617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.425229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.425507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.425703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.425796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.426403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.428380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.448903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 774/1574] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.449914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.458483 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 801/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.459248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.460109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2afa7-568a-4ec9-abcc-a25ba629be56 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.517511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.518125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.518403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.518676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.519340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.521547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.524157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36688622-bf11-4077-9826-c4807168c4bc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.528703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.529310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.529764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.530070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.530701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.532672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.548281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 775/1576] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.548281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.558963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14990-da4b-4871-92ac-11347b8b2b16 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.564446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.564984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.565261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.565371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 802/1577] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/projects => generated 389 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.565535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.566254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.566357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.567969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.580393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 776/1578] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.581390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.593758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23884d-d93e-4f7d-a636-8d700f45184f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.633866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b76253-ae93-4eac-ac05-e5d309b3e843 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.638704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.639121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.639662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.639839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.640475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.642391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.650202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.650817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.651091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.651398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.652050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.653954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.663647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:19.665738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 803/1579] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.666990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.672283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:19.678035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02dfed-b9e9-45b4-8250-e763ce61b044 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.681505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 777/1580] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.682337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.687505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.688143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.688422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.688854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.689537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.691269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.692373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dfbee-3e9d-41a6-8bf2-27b915b89f94 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.697106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.697742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.698022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.698330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.699029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.700653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.705877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 804/1581] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.705877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.711488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 778/1582] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.712194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.712791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be644511-befc-4305-8b52-8f0a2f58e19c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.717528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.718121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.718393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.718661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.719286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.721213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.723670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15749-2f53-4598-a33d-d1d09bdae95c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.728984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.729570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.729850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.730120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.730771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.732410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.743101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 779/1583] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.743101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.746603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 805/1584] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.746603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.753627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788d60f-e438-45c2-a834-76615253e167 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.757041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931880fe-2e44-46ba-9251-2c2380656be7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.758187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.758765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.759045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.759339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.760069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.761989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.762114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.762641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.762915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.763182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] PATH_INFO: `/v3/projects/acad305b31294fefbc0fea4f918b6369/users/fe5efa3c40c6483d81047d5c81540973/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.777855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acad305b31294fefbc0fea4f918b6369, user_id=fe5efa3c40c6483d81047d5c81540973, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.779177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:29:19.779177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:29:19.779177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:29:19.781558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.785432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 780/1585] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:19 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:19.786071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.795757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f75fc3-58b0-4997-ba70-138651cf651a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.795938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 806/1586] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:19 2022] PUT /identity/v3/projects/acad305b31294fefbc0fea4f918b6369/users/fe5efa3c40c6483d81047d5c81540973/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:19.796794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.857278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.857937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.858163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.858431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.859181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.860247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5218-4f6f-4399-a69a-a729504f42f2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.860788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.865254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.865870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.866147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.866439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.867076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.868701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.870888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 781/1587] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.871751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.878820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 807/1588] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.881902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.884618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33314df-030c-477f-b055-3367fe70ed9f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.889219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27406f-c586-44a8-9e53-ddd51395917b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.889634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.890291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.890570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.890843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] PATH_INFO: `/v3/projects/9b57407aaebb4cc785b7c7834e95924e/users/999a1f186ece4eabb99d7d6684469973/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.894281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.894869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.895144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.895412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.896080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.897680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.907252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b57407aaebb4cc785b7c7834e95924e, user_id=999a1f186ece4eabb99d7d6684469973, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.907954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 808/1589] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.908985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.909967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.919073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610e6e0-9253-47e9-bfd7-10d5021e4d12 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.928069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 782/1590] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:19 2022] PUT /identity/v3/projects/9b57407aaebb4cc785b7c7834e95924e/users/999a1f186ece4eabb99d7d6684469973/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:19.928069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.982332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.983055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.983332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.983656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.984314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.985946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.988686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369beb66-6578-4a4f-950a-57ae888c4ab5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.993469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3e35-e73f-41b0-af38-16331d6e1518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.994074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3e35-e73f-41b0-af38-16331d6e1518 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.994353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3e35-e73f-41b0-af38-16331d6e1518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.994625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3e35-e73f-41b0-af38-16331d6e1518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.995327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb3e35-e73f-41b0-af38-16331d6e1518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.995933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 809/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:19.996734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:19.997097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb3e35-e73f-41b0-af38-16331d6e1518 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.006189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35b935-e6aa-4988-b954-e6ed49123a86 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.011033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 783/1592] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:20.011033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291b74-0178-4b88-a4c0-e90522e19b27 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.011033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291b74-0178-4b88-a4c0-e90522e19b27 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.011033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9291b74-0178-4b88-a4c0-e90522e19b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.011410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.011514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.011854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.012125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.012766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.014551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.025281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 810/1593] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:20.028439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.038080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c66e4-f44f-48de-bba9-f71a0ed6b8fe admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.038526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c9291b74-0178-4b88-a4c0-e90522e19b27 None None] MFA Rules not processed for user `fe5efa3c40c6483d81047d5c81540973`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.039762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c9291b74-0178-4b88-a4c0-e90522e19b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.042794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.043407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.043861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.044128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.044748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.046454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.049693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:20.057126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 811/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:20.057953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.069805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d884a6-37db-4524-9a5a-369ded2fdf11 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.074540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.075133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.075405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.075708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.076342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.077960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.080250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:20.090560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 812/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:20.091412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.102324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef5097-9551-4616-93ac-744b9da98e87 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.106951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.107709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.107954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.108286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] PATH_INFO: `/v3/projects/19d36477277a4286b26f7ae173d35cc1/users/87188f90951d4402810cb659dcc147b2/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.111768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 784/1596] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:20.112923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d010e-6fd7-4d46-8bd4-a589c39ca6ed None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.113215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d010e-6fd7-4d46-8bd4-a589c39ca6ed None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.113496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d010e-6fd7-4d46-8bd4-a589c39ca6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.127876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d36477277a4286b26f7ae173d35cc1, user_id=87188f90951d4402810cb659dcc147b2, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.130502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.135153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0d3d010e-6fd7-4d46-8bd4-a589c39ca6ed None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.136403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0d3d010e-6fd7-4d46-8bd4-a589c39ca6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.144444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 785/1598] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:20.144595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 813/1598] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:20 2022] PUT /identity/v3/projects/19d36477277a4286b26f7ae173d35cc1/users/87188f90951d4402810cb659dcc147b2/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:20.145021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d010e-6fd7-4d46-8bd4-a589c39ca6ed None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.148278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.154357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d010e-6fd7-4d46-8bd4-a589c39ca6ed None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.213491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.214102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.214444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.214649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.215304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.216139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822665ed-6221-46c6-9e27-b3d0ac32dbb3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.217276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.221114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.221777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.222058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.222337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] PATH_INFO: `/v3/projects/848d1c8dc86e4d019850168d36e9c282/users/14edcf1140f840679b671523b5c29d38/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.227493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 786/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:20.231481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.237313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848d1c8dc86e4d019850168d36e9c282, user_id=14edcf1140f840679b671523b5c29d38, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.239987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.240948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae6457-6cdb-4880-814e-969dd51d843b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.245740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.246365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.246647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.246959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.247658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.249674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.254690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 814/1600] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:20 2022] PUT /identity/v3/projects/848d1c8dc86e4d019850168d36e9c282/users/14edcf1140f840679b671523b5c29d38/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:20.255654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.263163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 787/1601] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:20.263163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.270874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2974b-2d77-4d5d-a1a9-4bccb86c0548 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.325632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53083d1e-6f75-4361-ac87-4842473f9001 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.330265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.330930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.331206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.331475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] PATH_INFO: `/v3/projects/d7ffa8ba0d2d48419afeefd8d5cd4e23/users/bebd3b0bcdc04e77945fb9ddf8ca2d5c/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.333250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a40b50-f895-478c-bb09-42609c4fe38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.333950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40b50-f895-478c-bb09-42609c4fe38a admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.334223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40b50-f895-478c-bb09-42609c4fe38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.334495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a40b50-f895-478c-bb09-42609c4fe38a admin admin] PATH_INFO: `/v3/projects/4215a2ee6f6148789f9e7a1fcd189a40/users/211bf740a7e54b04acd2be64614848b5/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.346436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ffa8ba0d2d48419afeefd8d5cd4e23, user_id=bebd3b0bcdc04e77945fb9ddf8ca2d5c, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.348870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a40b50-f895-478c-bb09-42609c4fe38a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4215a2ee6f6148789f9e7a1fcd189a40, user_id=211bf740a7e54b04acd2be64614848b5, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.349151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.351735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a40b50-f895-478c-bb09-42609c4fe38a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.363738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 815/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:20 2022] PUT /identity/v3/projects/d7ffa8ba0d2d48419afeefd8d5cd4e23/users/bebd3b0bcdc04e77945fb9ddf8ca2d5c/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:20.364564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.366722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 788/1603] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:20 2022] PUT /identity/v3/projects/4215a2ee6f6148789f9e7a1fcd189a40/users/211bf740a7e54b04acd2be64614848b5/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:20.368238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010c04-dcfb-4197-ba98-4144f4df3daa None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.368522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010c04-dcfb-4197-ba98-4144f4df3daa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.368793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59010c04-dcfb-4197-ba98-4144f4df3daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.391102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:20.399461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-59010c04-dcfb-4197-ba98-4144f4df3daa None None] MFA Rules not processed for user `87188f90951d4402810cb659dcc147b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.402099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-59010c04-dcfb-4197-ba98-4144f4df3daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.421329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:20.435506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae9705-f759-466f-9da7-930ff3bb6e8a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.473170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 789/1604] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:20.474022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010c04-dcfb-4197-ba98-4144f4df3daa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.488264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.488982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.489262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.489535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.530110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59010c04-dcfb-4197-ba98-4144f4df3daa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.533860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb7b29-0294-46fc-b69e-1fc529ed2c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.534505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7b29-0294-46fc-b69e-1fc529ed2c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.534782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7b29-0294-46fc-b69e-1fc529ed2c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.535054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb7b29-0294-46fc-b69e-1fc529ed2c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.545664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.547121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.556570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 816/1605] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:20.557341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.598257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb7b29-0294-46fc-b69e-1fc529ed2c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.599734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb7b29-0294-46fc-b69e-1fc529ed2c4a service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.610346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 790/1606] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:20.611947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4953e-b670-441d-ba19-b136fa33c577 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.612204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4953e-b670-441d-ba19-b136fa33c577 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.612388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4953e-b670-441d-ba19-b136fa33c577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.622777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49237b6d-61d2-4a92-a8f1-a936a868f54e service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.628079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8b7af-60b3-4ffb-bd0a-a6bf0d19ec1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.628758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8b7af-60b3-4ffb-bd0a-a6bf0d19ec1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.629037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8b7af-60b3-4ffb-bd0a-a6bf0d19ec1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.629311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8b7af-60b3-4ffb-bd0a-a6bf0d19ec1f admin admin] PATH_INFO: `/v3/projects/9992a793b16f4862834bc3daf0e44ed2/users/dbd7677320d549a4bd492fa00a071f19/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.633189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3bc4953e-b670-441d-ba19-b136fa33c577 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.634395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3bc4953e-b670-441d-ba19-b136fa33c577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.644366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 791/1607] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:20.645187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4953e-b670-441d-ba19-b136fa33c577 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.648902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8b7af-60b3-4ffb-bd0a-a6bf0d19ec1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9992a793b16f4862834bc3daf0e44ed2, user_id=dbd7677320d549a4bd492fa00a071f19, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.656300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8b7af-60b3-4ffb-bd0a-a6bf0d19ec1f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.661674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4953e-b670-441d-ba19-b136fa33c577 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.667158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31104d-419e-4ad0-b116-04a2468bb27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.667878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31104d-419e-4ad0-b116-04a2468bb27a admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.668218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31104d-419e-4ad0-b116-04a2468bb27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.668418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31104d-419e-4ad0-b116-04a2468bb27a admin admin] PATH_INFO: `/v3/projects/3197f5ea54a24137b01f2288aea20dd6/users/aa1bc77ffe9245c8b1c8fa0ede1874b9/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.676811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 817/1608] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:20 2022] PUT /identity/v3/projects/9992a793b16f4862834bc3daf0e44ed2/users/dbd7677320d549a4bd492fa00a071f19/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:20.681617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353f52f-bade-4caa-be76-4fd577b064d7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.681906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353f52f-bade-4caa-be76-4fd577b064d7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.682182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353f52f-bade-4caa-be76-4fd577b064d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.686985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31104d-419e-4ad0-b116-04a2468bb27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3197f5ea54a24137b01f2288aea20dd6, user_id=aa1bc77ffe9245c8b1c8fa0ede1874b9, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.689986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a31104d-419e-4ad0-b116-04a2468bb27a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.706204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0353f52f-bade-4caa-be76-4fd577b064d7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.707450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0353f52f-bade-4caa-be76-4fd577b064d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.715224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 792/1609] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:20 2022] PUT /identity/v3/projects/3197f5ea54a24137b01f2288aea20dd6/users/aa1bc77ffe9245c8b1c8fa0ede1874b9/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:20.718305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.719266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.720265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.745555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:20.758083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] MFA Rules not processed for user `211bf740a7e54b04acd2be64614848b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.759359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.770425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:20.793742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 818/1610] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:20.794857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353f52f-bade-4caa-be76-4fd577b064d7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.806813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353f52f-bade-4caa-be76-4fd577b064d7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.812914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160089a-2db2-4bed-9c79-e542f172b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:20.814185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160089a-2db2-4bed-9c79-e542f172b358 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.814669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160089a-2db2-4bed-9c79-e542f172b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.815146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160089a-2db2-4bed-9c79-e542f172b358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.816158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160089a-2db2-4bed-9c79-e542f172b358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:20.818491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160089a-2db2-4bed-9c79-e542f172b358 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:20.859822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 793/1611] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:20.860810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:20.864347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.868752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 819/1612] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:20.870690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5048c-9fbf-41d5-a1fc-85dc2bb0c87a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.871236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5048c-9fbf-41d5-a1fc-85dc2bb0c87a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.871669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5048c-9fbf-41d5-a1fc-85dc2bb0c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.905611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e2f5048c-9fbf-41d5-a1fc-85dc2bb0c87a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.908833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e2f5048c-9fbf-41d5-a1fc-85dc2bb0c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.961108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b192dc-7a04-4d1c-8cd5-0dfbc79e581d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:20.992804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 820/1613] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:20.994901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6eaf-653d-4fe1-a8ae-3617fed7ce63 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.995847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6eaf-653d-4fe1-a8ae-3617fed7ce63 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.996324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6eaf-653d-4fe1-a8ae-3617fed7ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.020518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a6ae6eaf-653d-4fe1-a8ae-3617fed7ce63 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:21.022621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a6ae6eaf-653d-4fe1-a8ae-3617fed7ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:21.032740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.033526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.033881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.034225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.046767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.051167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 821/1614] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:21.051337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.051658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6eaf-653d-4fe1-a8ae-3617fed7ce63 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.071710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6eaf-653d-4fe1-a8ae-3617fed7ce63 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.072125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 794/1615] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:21.073276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.082762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.083488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.083866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.084277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.088235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8afb-5126-4d54-aa0d-c16b8dd109a3 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.096928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.097654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.098000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.098338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.099043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.101639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.102731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.106215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.131670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 822/1616] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:21.133012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.142121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 795/1617] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:21 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:21.143157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.145712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2672a-7145-4fe9-a758-6a84243f15f5 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.224071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.225071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.226870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.227312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.228287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.230552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.246184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:21.255072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510faa8-f6e9-41b8-8ca8-d0cce7b7aa8a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.261961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.262737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.262894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.263128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.270727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 823/1618] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:21 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:21.271747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.286871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.289885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.297527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1313760-13aa-4f15-8f76-9b200450477e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.303952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 796/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:21.304503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.304862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.305335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.305643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.305922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.323733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49222803-850c-420f-aef7-bf39b53a2f83 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.327065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.328744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.329526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.330724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.331075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.331354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.332121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.334921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.348392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 824/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:21.349536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.381186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d6c33-3ea8-4237-a4be-10fdd39ce7a3 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.382940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.383607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.384118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.384249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.384914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.386934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.390085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:21.408048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 797/1621] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:21 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:21.408048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.420198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 825/1622] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:21.422624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.431002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aa4f1-2dee-4a9a-869a-0fe8c30563b4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.440550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549267-283a-4c16-885a-5c5130aeac05 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.442654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.443370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.443554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.443944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.444550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.446543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.456048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.456742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.457022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.457297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] PATH_INFO: `/v3/projects/44bfe127fe41450781ff5cc85e3eac33/users/50b2f8f74d794005a407b0330a59ca2e/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.473511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 798/1623] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:21.479019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.483430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44bfe127fe41450781ff5cc85e3eac33, user_id=50b2f8f74d794005a407b0330a59ca2e, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.486255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.498350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75a629-055d-428b-ba25-7ebc6ddcfb71 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.506600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.507279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.507582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.507836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] PATH_INFO: `/v3/projects/c7d5fe02473c4159843a9ccde7dd385f/users/1815b3035f2442a99cd6e7b21c38205d/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.511580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 826/1624] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:21 2022] PUT /identity/v3/projects/44bfe127fe41450781ff5cc85e3eac33/users/50b2f8f74d794005a407b0330a59ca2e/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:21.515891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.532596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d5fe02473c4159843a9ccde7dd385f, user_id=1815b3035f2442a99cd6e7b21c38205d, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.540192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.563325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 799/1625] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:21 2022] PUT /identity/v3/projects/c7d5fe02473c4159843a9ccde7dd385f/users/1815b3035f2442a99cd6e7b21c38205d/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:29:21.567852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.617963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465497b-10f4-4c6b-a04b-46fe85c88692 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.674226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91060dd3-6f70-4291-9207-1a68b52e147f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.681520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.682179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.682423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.682697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.683455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.686159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.706404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 800/1626] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:21.707657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.723172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.724080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.724779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.724779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.725975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.728474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.728815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2810a-dcb3-43f7-8765-3838661426b8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.735422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fe78c-ae17-4025-934e-a47bcf9e1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.736499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fe78c-ae17-4025-934e-a47bcf9e1fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.737081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fe78c-ae17-4025-934e-a47bcf9e1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.737424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fe78c-ae17-4025-934e-a47bcf9e1fb5 admin admin] PATH_INFO: `/v3/projects/c7d5fe02473c4159843a9ccde7dd385f/users/1815b3035f2442a99cd6e7b21c38205d/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.739842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fe78c-ae17-4025-934e-a47bcf9e1fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d5fe02473c4159843a9ccde7dd385f, user_id=1815b3035f2442a99cd6e7b21c38205d, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.743028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fe78c-ae17-4025-934e-a47bcf9e1fb5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.759796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 827/1627] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:29:21.761105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.773118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 801/1628] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:21 2022] PUT /identity/v3/projects/c7d5fe02473c4159843a9ccde7dd385f/users/1815b3035f2442a99cd6e7b21c38205d/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:21.774974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838a461-061e-42ee-b902-91d246c022f2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.775343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838a461-061e-42ee-b902-91d246c022f2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.775870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838a461-061e-42ee-b902-91d246c022f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.796775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273c920-f200-47b9-861d-e91cfd377827 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.840358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a838a461-061e-42ee-b902-91d246c022f2 None None] MFA Rules not processed for user `1815b3035f2442a99cd6e7b21c38205d`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:21.848431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a838a461-061e-42ee-b902-91d246c022f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:21.931715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7727ca-69ea-488c-a8ad-2e627599b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:21.932619 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7727ca-69ea-488c-a8ad-2e627599b738 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.933034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7727ca-69ea-488c-a8ad-2e627599b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.933484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7727ca-69ea-488c-a8ad-2e627599b738 admin admin] PATH_INFO: `/v3/projects/44bfe127fe41450781ff5cc85e3eac33/users/50b2f8f74d794005a407b0330a59ca2e/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:21.939471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7727ca-69ea-488c-a8ad-2e627599b738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44bfe127fe41450781ff5cc85e3eac33, user_id=50b2f8f74d794005a407b0330a59ca2e, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:21.944345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7727ca-69ea-488c-a8ad-2e627599b738 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:21.972348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 802/1629] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:21.981091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 828/1630] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:21 2022] PUT /identity/v3/projects/44bfe127fe41450781ff5cc85e3eac33/users/50b2f8f74d794005a407b0330a59ca2e/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:21.990453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838a461-061e-42ee-b902-91d246c022f2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.992793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185195b-fa87-4ffa-b570-5acc5f502a2e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:21.993039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185195b-fa87-4ffa-b570-5acc5f502a2e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:21.993460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185195b-fa87-4ffa-b570-5acc5f502a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.002051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:22.054114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:22.081566 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7185195b-fa87-4ffa-b570-5acc5f502a2e None None] MFA Rules not processed for user `50b2f8f74d794005a407b0330a59ca2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:22.085584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7185195b-fa87-4ffa-b570-5acc5f502a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:22.145142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838a461-061e-42ee-b902-91d246c022f2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:22.209094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 829/1631] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:22.239186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185195b-fa87-4ffa-b570-5acc5f502a2e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:22.316679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:22.317829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.318263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.318692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.368699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185195b-fa87-4ffa-b570-5acc5f502a2e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:22.379925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8162e-bde3-45be-be05-d12579e9764c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:22.382674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8162e-bde3-45be-be05-d12579e9764c service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.387192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8162e-bde3-45be-be05-d12579e9764c service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.387754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8162e-bde3-45be-be05-d12579e9764c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.495174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:22.497652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:22.527782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 803/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:22.554084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8162e-bde3-45be-be05-d12579e9764c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:22.557705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8162e-bde3-45be-be05-d12579e9764c service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:22.600751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 830/1633] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:22.813027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:22.830967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392d841-737b-4eb1-8ab3-d984aaac0997 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:22.834794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9e9f5-7afa-4725-8764-79cad012a67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:22.835414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e9f5-7afa-4725-8764-79cad012a67d service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.836288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e9f5-7afa-4725-8764-79cad012a67d service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.836288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9e9f5-7afa-4725-8764-79cad012a67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.958815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9e9f5-7afa-4725-8764-79cad012a67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:22.960317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9e9f5-7afa-4725-8764-79cad012a67d service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:22.972423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 804/1634] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:23.180610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b0a88-88ca-4f7f-8831-bd1c08e49cad None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.180930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b0a88-88ca-4f7f-8831-bd1c08e49cad None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.181210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b0a88-88ca-4f7f-8831-bd1c08e49cad None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.183605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 831/1635] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 05:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:23.192798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706dd81-6ebc-483a-a7e4-e02c2cb9dfb4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.193374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706dd81-6ebc-483a-a7e4-e02c2cb9dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.193812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706dd81-6ebc-483a-a7e4-e02c2cb9dfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.224867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:23.256974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6706dd81-6ebc-483a-a7e4-e02c2cb9dfb4 None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:23.259018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6706dd81-6ebc-483a-a7e4-e02c2cb9dfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:23.355302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 805/1636] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:23.363784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680454e0-44e8-41f7-9f6e-4d0f314cb420 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.364119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680454e0-44e8-41f7-9f6e-4d0f314cb420 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.364403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680454e0-44e8-41f7-9f6e-4d0f314cb420 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.365870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 832/1637] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 05:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:23.372462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a80f5-d8e0-4113-87d3-8b9441bf426f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.372749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a80f5-d8e0-4113-87d3-8b9441bf426f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.373030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a80f5-d8e0-4113-87d3-8b9441bf426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.397273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-163a80f5-d8e0-4113-87d3-8b9441bf426f None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:23.399096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-163a80f5-d8e0-4113-87d3-8b9441bf426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:23.419845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 806/1638] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:29:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:23.469758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680454e0-44e8-41f7-9f6e-4d0f314cb420 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:23.490704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680454e0-44e8-41f7-9f6e-4d0f314cb420 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:23.494636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2328c-0fc4-461d-af42-f6c742891a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:23.495355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2328c-0fc4-461d-af42-f6c742891a53 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.496419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2328c-0fc4-461d-af42-f6c742891a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.496769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2328c-0fc4-461d-af42-f6c742891a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.508299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2328c-0fc4-461d-af42-f6c742891a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:23.510868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2328c-0fc4-461d-af42-f6c742891a53 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:23.524464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 833/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:24.580209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a80f5-d8e0-4113-87d3-8b9441bf426f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:24.596005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a80f5-d8e0-4113-87d3-8b9441bf426f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:24.605825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4aa625-7d1b-4035-a904-ebb386167220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:24.606831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa625-7d1b-4035-a904-ebb386167220 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.606831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa625-7d1b-4035-a904-ebb386167220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.607022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4aa625-7d1b-4035-a904-ebb386167220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.632978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4aa625-7d1b-4035-a904-ebb386167220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:24.634586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4aa625-7d1b-4035-a904-ebb386167220 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:24.652997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 807/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:25.675335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7a05-8f76-4be1-a0bf-da66b3f19344 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.675998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7a05-8f76-4be1-a0bf-da66b3f19344 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.676083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7a05-8f76-4be1-a0bf-da66b3f19344 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.678214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 834/1641] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 05:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:25.687402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c823b-c28c-4f81-ab7b-aa8da3f2ebde None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.688539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c823b-c28c-4f81-ab7b-aa8da3f2ebde None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.690327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c823b-c28c-4f81-ab7b-aa8da3f2ebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.748640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-256c823b-c28c-4f81-ab7b-aa8da3f2ebde None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:25.752108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-256c823b-c28c-4f81-ab7b-aa8da3f2ebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:25.783900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 808/1642] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 05:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:25.787288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9cc7-bf22-42ec-8338-ca8c0b6f1a98 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.788355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9cc7-bf22-42ec-8338-ca8c0b6f1a98 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.788847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e9cc7-bf22-42ec-8338-ca8c0b6f1a98 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.790449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 835/1643] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 05:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:25.823345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd185cc-9724-4459-ba85-547159341792 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.823345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd185cc-9724-4459-ba85-547159341792 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.823345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd185cc-9724-4459-ba85-547159341792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.851051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dfd185cc-9724-4459-ba85-547159341792 None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:25.852529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dfd185cc-9724-4459-ba85-547159341792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:25.881304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 809/1644] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:29:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:25.897149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9cc7-bf22-42ec-8338-ca8c0b6f1a98 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.914925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e9cc7-bf22-42ec-8338-ca8c0b6f1a98 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.925974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a1e13-4969-443f-8184-b27a9eb4525b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.927297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1e13-4969-443f-8184-b27a9eb4525b service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.927770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1e13-4969-443f-8184-b27a9eb4525b service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.928192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a1e13-4969-443f-8184-b27a9eb4525b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.944901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a1e13-4969-443f-8184-b27a9eb4525b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:25.947671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a1e13-4969-443f-8184-b27a9eb4525b service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:25.981122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 836/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:30.218374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd185cc-9724-4459-ba85-547159341792 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:30.438876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd185cc-9724-4459-ba85-547159341792 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:30.455296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:30.456195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:30.456479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:30.456758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] PATH_INFO: `/v3/users/87188f90951d4402810cb659dcc147b2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:30.459454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87188f90951d4402810cb659dcc147b2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:30.462411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:30.602465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87188f90951d4402810cb659dcc147b2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:30.625394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87188f90951d4402810cb659dcc147b2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:30.629854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:30.678168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87188f90951d4402810cb659dcc147b2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:30.679313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87188f90951d4402810cb659dcc147b2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:30.722918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87188f90951d4402810cb659dcc147b2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:30.748985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 810/1646] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:30 2022] DELETE /identity/v3/users/87188f90951d4402810cb659dcc147b2 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:30.753800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:30.754371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:30.754371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:30.791840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:30.793149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:30.840003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:30.957692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 837/1647] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:31.025050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:31.027010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:31.179686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40b554-bf57-43eb-bedb-b6ccf4c18b95 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:31.184689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:31.185363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:31.185669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:31.185928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:31.197079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:31.198788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:31.231445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 811/1648] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:32.982683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:32.985272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:33.041947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9286af-c41a-404f-8e0a-cc26d2f1c5a9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.056130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.058007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.058235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.059654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] PATH_INFO: `/v3/projects/19d36477277a4286b26f7ae173d35cc1` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.064546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d36477277a4286b26f7ae173d35cc1)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:33.069161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:33.318145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d36477277a4286b26f7ae173d35cc1', 'request_id': 'req-c7a87d90-9bf3-44bb-82b2-647396d1db0d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.344721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d36477277a4286b26f7ae173d35cc1', 'request_id': 'req-c7a87d90-9bf3-44bb-82b2-647396d1db0d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.353986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d36477277a4286b26f7ae173d35cc1', 'request_id': 'req-c7a87d90-9bf3-44bb-82b2-647396d1db0d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.380955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] The token cache is being invalidate because project 19d36477277a4286b26f7ae173d35cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:33.381969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.383145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.391610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 838/1649] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:32 2022] DELETE /identity/v3/projects/19d36477277a4286b26f7ae173d35cc1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:33.397210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.413889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa002e1-34a9-404c-a2e1-9a3318cce661 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.565159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.566672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.567074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.567446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] PATH_INFO: `/v3/users/50b2f8f74d794005a407b0330a59ca2e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.568915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50b2f8f74d794005a407b0330a59ca2e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:33.570985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:33.704242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50b2f8f74d794005a407b0330a59ca2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.717340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50b2f8f74d794005a407b0330a59ca2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.768868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50b2f8f74d794005a407b0330a59ca2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.775213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50b2f8f74d794005a407b0330a59ca2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.781785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:33.785678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50b2f8f74d794005a407b0330a59ca2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:33.800252 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 812/1650] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:33 2022] DELETE /identity/v3/users/50b2f8f74d794005a407b0330a59ca2e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:33.844218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.850527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:33.881281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a87d90-9bf3-44bb-82b2-647396d1db0d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.057374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.058062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.058715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.059291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] PATH_INFO: `/v3/users/fe5efa3c40c6483d81047d5c81540973` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.061083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5efa3c40c6483d81047d5c81540973)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.062523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: WARNING py.warnings [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:29:34.062523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: warnings.warn(msg) Sep 26 05:29:34.062523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: Sep 26 05:29:34.064947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.074616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.076278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:34.108980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cc963-0291-4571-bf00-ce117b9d989c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.120688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.121414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.121757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.122029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] PATH_INFO: `/v3/users/211bf740a7e54b04acd2be64614848b5` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.123412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211bf740a7e54b04acd2be64614848b5)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.125858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.190951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5efa3c40c6483d81047d5c81540973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.199630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:34.211054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5efa3c40c6483d81047d5c81540973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.212833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5efa3c40c6483d81047d5c81540973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.251525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5efa3c40c6483d81047d5c81540973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.289857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211bf740a7e54b04acd2be64614848b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.324946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211bf740a7e54b04acd2be64614848b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.342080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f7c07086-1c90-4579-9842-1aed0fe594c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5efa3c40c6483d81047d5c81540973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.368047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211bf740a7e54b04acd2be64614848b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.371877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 839/1651] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:33 2022] DELETE /identity/v3/users/fe5efa3c40c6483d81047d5c81540973 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:34.374342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211bf740a7e54b04acd2be64614848b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.376035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.376787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.378770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.395570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-70a739ca-fb3a-4884-939d-550a6a9042d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211bf740a7e54b04acd2be64614848b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:34.413405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 813/1652] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:34 2022] DELETE /identity/v3/users/211bf740a7e54b04acd2be64614848b5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:34.422076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.423134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.423632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.431691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:34.437119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:34.475609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:34.479780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:34.605386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 840/1653] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:34.687229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 814/1654] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:34.692764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.694361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:34.713520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.715165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:34.876228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4142fdc-8338-4d7f-9ea5-23153e507b22 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.892446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc673a02-f5bf-4442-ba70-a906f251c698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.895614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673a02-f5bf-4442-ba70-a906f251c698 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.896104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673a02-f5bf-4442-ba70-a906f251c698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.896546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc673a02-f5bf-4442-ba70-a906f251c698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.947486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad441876-88f1-48f2-ac08-766359f04fef None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.956054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc673a02-f5bf-4442-ba70-a906f251c698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.958002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc673a02-f5bf-4442-ba70-a906f251c698 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.965298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.965949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.966233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.966539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.975250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 841/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:34.992752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.994275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:35.014527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 815/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:35.863760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.864594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.865016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.963375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] MFA Rules not processed for user `bebd3b0bcdc04e77945fb9ddf8ca2d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:35.964845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:36.132373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:36.145445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 842/1657] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:36.176529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.179517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:36.203698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:36.413271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be55ae-a277-4dd1-b711-dc0c528bb432 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.428471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec2167-b285-45c5-9947-d9a56ec329e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.429596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2167-b285-45c5-9947-d9a56ec329e9 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.429596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2167-b285-45c5-9947-d9a56ec329e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.430125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec2167-b285-45c5-9947-d9a56ec329e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.452742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec2167-b285-45c5-9947-d9a56ec329e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:36.454404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec2167-b285-45c5-9947-d9a56ec329e9 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:36.479614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 816/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:36.743830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.745312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:36.786409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480909c8-550a-4dba-9aab-b256960eb004 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.810720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.811401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.811715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.811991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] PATH_INFO: `/v3/projects/acad305b31294fefbc0fea4f918b6369` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.814372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acad305b31294fefbc0fea4f918b6369)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:36.816368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:36.981348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acad305b31294fefbc0fea4f918b6369', 'request_id': 'req-b8638d6d-fe79-4353-b300-e87714199412'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.011453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acad305b31294fefbc0fea4f918b6369', 'request_id': 'req-b8638d6d-fe79-4353-b300-e87714199412'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.020807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acad305b31294fefbc0fea4f918b6369', 'request_id': 'req-b8638d6d-fe79-4353-b300-e87714199412'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.054142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] The token cache is being invalidate because project acad305b31294fefbc0fea4f918b6369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:37.054482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.055438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b8638d6d-fe79-4353-b300-e87714199412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.057779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 843/1659] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:36 2022] DELETE /identity/v3/projects/acad305b31294fefbc0fea4f918b6369 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:37.063225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d47ce-e86a-42d0-b95e-d30d9df18324 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.063526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d47ce-e86a-42d0-b95e-d30d9df18324 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.063866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d47ce-e86a-42d0-b95e-d30d9df18324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.120262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b12d47ce-e86a-42d0-b95e-d30d9df18324 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:37.128839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b12d47ce-e86a-42d0-b95e-d30d9df18324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:37.308390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 817/1660] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:37.317067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bc5e-3c67-4a62-b21b-9875a181fecb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.317357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bc5e-3c67-4a62-b21b-9875a181fecb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.317633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bc5e-3c67-4a62-b21b-9875a181fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.383240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e945bc5e-3c67-4a62-b21b-9875a181fecb None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:37.385005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e945bc5e-3c67-4a62-b21b-9875a181fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:37.402169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 844/1661] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:37.404033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d47ce-e86a-42d0-b95e-d30d9df18324 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.420951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d47ce-e86a-42d0-b95e-d30d9df18324 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.432913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.433608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.433893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.434167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.434899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:37.435637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.437368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.471788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 818/1662] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:37.476639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bc5e-3c67-4a62-b21b-9875a181fecb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.500800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bc5e-3c67-4a62-b21b-9875a181fecb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.525474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.526160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.526744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.526844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.527483 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.532008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.561792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.563856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:37.587484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad7eff-851a-4870-9874-6a831f65db75 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.603094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.604829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.606953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.608151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] PATH_INFO: `/v3/projects/44bfe127fe41450781ff5cc85e3eac33` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.612697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44bfe127fe41450781ff5cc85e3eac33)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.616280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: WARNING py.warnings [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:29:37.616280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: warnings.warn(msg) Sep 26 05:29:37.616280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: Sep 26 05:29:37.618825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.662808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 845/1663] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:37 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:37.667803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.797721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44bfe127fe41450781ff5cc85e3eac33', 'request_id': 'req-d0f2c76e-f0c8-49be-8733-db389b89f98f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.820291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44bfe127fe41450781ff5cc85e3eac33', 'request_id': 'req-d0f2c76e-f0c8-49be-8733-db389b89f98f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.849852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44bfe127fe41450781ff5cc85e3eac33', 'request_id': 'req-d0f2c76e-f0c8-49be-8733-db389b89f98f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.876526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] The token cache is being invalidate because project 44bfe127fe41450781ff5cc85e3eac33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:37.876767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.878898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d0f2c76e-f0c8-49be-8733-db389b89f98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:37.883953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 819/1664] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:37 2022] DELETE /identity/v3/projects/44bfe127fe41450781ff5cc85e3eac33 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:37.886184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432ae3-9acd-461c-8220-076cc6dcb066 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.886420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432ae3-9acd-461c-8220-076cc6dcb066 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.886781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432ae3-9acd-461c-8220-076cc6dcb066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.893675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d73315-67d3-44cc-b9dd-ca03c96de636 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.922770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:37.933786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-be432ae3-9acd-461c-8220-076cc6dcb066 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:37.940292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-be432ae3-9acd-461c-8220-076cc6dcb066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:38.074006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.076395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.076681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.077062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.077736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.080195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.097448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:38.108179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 820/1665] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:38.110108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f92c-c057-49b4-a91f-b64d0cd41ede None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.110405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f92c-c057-49b4-a91f-b64d0cd41ede None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.110741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667f92c-c057-49b4-a91f-b64d0cd41ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.146045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 846/1666] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:37 2022] POST /identity/v3/users => generated 288 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:38.147227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.152309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:38.152459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c667f92c-c057-49b4-a91f-b64d0cd41ede None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:38.153520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c667f92c-c057-49b4-a91f-b64d0cd41ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:38.178640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 821/1667] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:38.183637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667f92c-c057-49b4-a91f-b64d0cd41ede None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.194486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2e58a-c6b9-4011-9228-1d3f528fabbb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.202449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667f92c-c057-49b4-a91f-b64d0cd41ede None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.208231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.209091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.210879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.211328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.212468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.219853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.221375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.222073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.222829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.227610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.228565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:38.229040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.230902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.260305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 822/1668] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:38.264538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.269207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 847/1669] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:38.274284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.289218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcc167-d0f8-4273-880d-4d58573cb582 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.303217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8fa2c-dee2-4606-b744-e1e409292749 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.305455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.306152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.306434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.306746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.307410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.310037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.318859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.319985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.320302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.320691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.321168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.322837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.361836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 848/1670] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:38.362865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.373474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 823/1671] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:38 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:29:38.377651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.390951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52705a5-2fb6-489e-b4a1-2c6b8f7ba6be admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.525048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.525885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.526257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.526799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] PATH_INFO: `/v3/projects/bf4d1be0362c4d079229a4b5bba72e2d/users/960baaf1a658477fb5847c1cdb2cf880/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.538431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5a23e-1c5b-4fd2-a9f8-7c14f19b6b7c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.555313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.556161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.556885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.557337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.559535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.568033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.576537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4d1be0362c4d079229a4b5bba72e2d, user_id=960baaf1a658477fb5847c1cdb2cf880, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.579628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.619599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 849/1672] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:38 2022] PUT /identity/v3/projects/bf4d1be0362c4d079229a4b5bba72e2d/users/960baaf1a658477fb5847c1cdb2cf880/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:38.620858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.624755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 824/1673] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:38 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:29:38.625774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:38.628930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.652127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a80d-9371-4054-b99c-b627c5e69598 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.806012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:38.809157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d47dc-dbc9-4ed8-84cc-0c66c4f3a9dc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.820437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.821476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.821476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.821688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] PATH_INFO: `/v3/projects/4215a2ee6f6148789f9e7a1fcd189a40` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.823508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b5efd-3bf7-4e06-b206-339141ef3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.824222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5efd-3bf7-4e06-b206-339141ef3815 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.824451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5efd-3bf7-4e06-b206-339141ef3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.824724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b5efd-3bf7-4e06-b206-339141ef3815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.825377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b5efd-3bf7-4e06-b206-339141ef3815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.827107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b5efd-3bf7-4e06-b206-339141ef3815 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.829842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4215a2ee6f6148789f9e7a1fcd189a40)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.831936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.868033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 825/1674] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:29:38.869415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.871397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.875879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.942056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] MFA Rules not processed for user `960baaf1a658477fb5847c1cdb2cf880`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:38.945229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:38.952478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4215a2ee6f6148789f9e7a1fcd189a40', 'request_id': 'req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:38.961210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:38.975220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4215a2ee6f6148789f9e7a1fcd189a40', 'request_id': 'req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:38.988377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4215a2ee6f6148789f9e7a1fcd189a40', 'request_id': 'req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.021004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] The token cache is being invalidate because project 4215a2ee6f6148789f9e7a1fcd189a40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:39.021311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.022016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-525cdcd9-661d-4d35-9aaf-a47f8e8953a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.023783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 850/1675] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:38 2022] DELETE /identity/v3/projects/4215a2ee6f6148789f9e7a1fcd189a40 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:39.027839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.028151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.028437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.100344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] MFA Rules not processed for user `aa1bc77ffe9245c8b1c8fa0ede1874b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:39.104087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.124010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 826/1676] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:39.125382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.128419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.287313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 851/1677] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:39.288425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.289989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.323095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612942c-b4a8-4f5e-b732-63ede684be0e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.334202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.336982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.337293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.337615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.339956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.345512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.371802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 827/1678] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:39.373034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.376292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.388562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1644c56-2410-4b51-8a4d-cbadb7955cb5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.404459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.405379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.405974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.406599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] PATH_INFO: `/v3/users/1815b3035f2442a99cd6e7b21c38205d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.410496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1815b3035f2442a99cd6e7b21c38205d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.412802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.495086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57377bf2-e920-43c7-ac57-aec01148b51d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.502484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.503318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.503652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.503933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.513639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.514068 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1815b3035f2442a99cd6e7b21c38205d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.515396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.528956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 828/1679] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:39.529931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.531302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1815b3035f2442a99cd6e7b21c38205d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.531410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.532491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1815b3035f2442a99cd6e7b21c38205d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.542218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:39.545320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1815b3035f2442a99cd6e7b21c38205d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.579236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:39.588557 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1815b3035f2442a99cd6e7b21c38205d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:39.597736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fda5b0-2892-45a2-9523-5bb4418bcb27 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.607780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 852/1680] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:39 2022] DELETE /identity/v3/users/1815b3035f2442a99cd6e7b21c38205d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:39.615862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce6e39-79cf-489d-82be-e19ab0aaf3fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.616785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6e39-79cf-489d-82be-e19ab0aaf3fe service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.617353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6e39-79cf-489d-82be-e19ab0aaf3fe service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.617635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce6e39-79cf-489d-82be-e19ab0aaf3fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.618289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.622386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-26ce6e39-79cf-489d-82be-e19ab0aaf3fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.623922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.650524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce6e39-79cf-489d-82be-e19ab0aaf3fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.656932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce6e39-79cf-489d-82be-e19ab0aaf3fe service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.699342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 829/1681] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:39.731078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.739732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.740886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.864042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] MFA Rules not processed for user `999a1f186ece4eabb99d7d6684469973`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:39.868557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:39.892715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574b6f2-4dcf-47d7-87f3-18e2480abf9a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.901689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e6541-7b88-4b6c-943f-e0afcbfc2c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.902378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6541-7b88-4b6c-943f-e0afcbfc2c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.902661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6541-7b88-4b6c-943f-e0afcbfc2c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.902918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e6541-7b88-4b6c-943f-e0afcbfc2c7a admin admin] PATH_INFO: `/v3/projects/e0af1df7586b4ef1b50ba77bccef2928/users/247c2c2a1c3743bcabf2906b239bf131/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.956096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e6541-7b88-4b6c-943f-e0afcbfc2c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0af1df7586b4ef1b50ba77bccef2928, user_id=247c2c2a1c3743bcabf2906b239bf131, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.959272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e6541-7b88-4b6c-943f-e0afcbfc2c7a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.989668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 853/1682] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:39 2022] PUT /identity/v3/projects/e0af1df7586b4ef1b50ba77bccef2928/users/247c2c2a1c3743bcabf2906b239bf131/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:39.990909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42d95-72d8-47b2-a1ae-c3d5653a4bca None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.991190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42d95-72d8-47b2-a1ae-c3d5653a4bca None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.991458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be42d95-72d8-47b2-a1ae-c3d5653a4bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.097243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 830/1683] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:40.098270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:40.101231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9be42d95-72d8-47b2-a1ae-c3d5653a4bca None None] MFA Rules not processed for user `14edcf1140f840679b671523b5c29d38`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:40.106020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9be42d95-72d8-47b2-a1ae-c3d5653a4bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.108344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.130699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89b8a1-af97-470d-8dee-87f09adfcab5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:40.312134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:40.315853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.316206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.317828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] PATH_INFO: `/v3/users/960baaf1a658477fb5847c1cdb2cf880` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.322754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=960baaf1a658477fb5847c1cdb2cf880)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:40.326204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 854/1684] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:40.328231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6b31-2344-4010-b28d-9e396b7654db None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.328522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6b31-2344-4010-b28d-9e396b7654db None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.328869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d6b31-2344-4010-b28d-9e396b7654db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.330480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:40.398348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-736d6b31-2344-4010-b28d-9e396b7654db None None] MFA Rules not processed for user `247c2c2a1c3743bcabf2906b239bf131`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:40.411798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-736d6b31-2344-4010-b28d-9e396b7654db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.491152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960baaf1a658477fb5847c1cdb2cf880'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:40.516983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960baaf1a658477fb5847c1cdb2cf880'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:40.551363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960baaf1a658477fb5847c1cdb2cf880'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:40.553337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960baaf1a658477fb5847c1cdb2cf880'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:40.568393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:40.577475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6417b34c-e1e2-44cb-9df3-51bc82286e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960baaf1a658477fb5847c1cdb2cf880'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:40.593753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:40.602710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 855/1685] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:40.603264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.603960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.606423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.610980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 831/1686] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:40 2022] DELETE /identity/v3/users/960baaf1a658477fb5847c1cdb2cf880 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:40.613147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b28053-deed-4299-a466-7792c5d15fcd None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.617608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b28053-deed-4299-a466-7792c5d15fcd None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.618149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b28053-deed-4299-a466-7792c5d15fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.652467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] MFA Rules not processed for user `999a1f186ece4eabb99d7d6684469973`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:40.655306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.666474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-83b28053-deed-4299-a466-7792c5d15fcd None None] MFA Rules not processed for user `14edcf1140f840679b671523b5c29d38`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:40.667933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-83b28053-deed-4299-a466-7792c5d15fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.819178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 856/1687] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:40.820260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:40.824693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.849086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 832/1688] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:40.851878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.864008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.864409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.919108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:40.922622 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.022403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf0162e-90de-4503-a844-824cf5564f9c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.038255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e2b88-08af-4b7b-b85c-48a54e9ebc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.040456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e2b88-08af-4b7b-b85c-48a54e9ebc24 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.040646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e2b88-08af-4b7b-b85c-48a54e9ebc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.041459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e2b88-08af-4b7b-b85c-48a54e9ebc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.042743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e2b88-08af-4b7b-b85c-48a54e9ebc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:41.046965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e2b88-08af-4b7b-b85c-48a54e9ebc24 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:41.114709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 833/1689] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:41.115362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.122089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.129678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 857/1690] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:40 2022] POST /identity/v3/projects => generated 381 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:41.129678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.129678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.129678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.208528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] MFA Rules not processed for user `dbd7677320d549a4bd492fa00a071f19`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:41.209693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.368767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b80693-4480-4abb-bd44-44f43450f0a7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.439063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 858/1691] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:41.440283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.442161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.489183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:41.504563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:41.571012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.571343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.571651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.571923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.578748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.633472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160273ae-765f-4241-aa76-0c065bf8b360 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.648018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.649330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.649843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.650411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.655373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.764953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:41.766607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:41.790118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:41.793264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:41.804038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 834/1692] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:41.805964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.821555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 859/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:41.822685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.829877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.949906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201d908-ecb1-4f8f-bb79-f7088c17306a service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.954318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.955237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.956043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.956425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.056124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a954-e8fe-4757-8bfd-8842ea52b82e service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.068326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.069031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.069395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.069593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.070409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.078619 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.139664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.141649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.147880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:42.156293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 860/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:42.157765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.160747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:42.171079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 835/1695] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:41 2022] POST /identity/v3/users => generated 297 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:42.175481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.200811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a77a2-a0dc-4587-a9c7-795d8ba9885c service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.206207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d577e-25be-442c-9e70-7b1cb9854788 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.217752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.218434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.218718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.218995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] PATH_INFO: `/v3/projects/c7d5fe02473c4159843a9ccde7dd385f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.225774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.230794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.231483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.231794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.232732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d5fe02473c4159843a9ccde7dd385f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.237579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.241142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.247345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.296887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 836/1696] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:42.298085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.334790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30692961-98cb-4490-9e9e-b10458b5d4c0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.352744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.355095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.355428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.357174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] PATH_INFO: `/v3/projects/5c73afa24d204f40a36e751b003ab9ad/users/8ed48cf7959d4e8b8e5ec3b0603bb30e/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.420262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c73afa24d204f40a36e751b003ab9ad, user_id=8ed48cf7959d4e8b8e5ec3b0603bb30e, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.423009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.425088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d5fe02473c4159843a9ccde7dd385f', 'request_id': 'req-9d34716a-3090-4666-a7b7-5c6b2da8dd64'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:42.441379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d5fe02473c4159843a9ccde7dd385f', 'request_id': 'req-9d34716a-3090-4666-a7b7-5c6b2da8dd64'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:42.456869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d5fe02473c4159843a9ccde7dd385f', 'request_id': 'req-9d34716a-3090-4666-a7b7-5c6b2da8dd64'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:42.463695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 837/1697] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:42 2022] PUT /identity/v3/projects/5c73afa24d204f40a36e751b003ab9ad/users/8ed48cf7959d4e8b8e5ec3b0603bb30e/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:42.468414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.495668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] The token cache is being invalidate because project c7d5fe02473c4159843a9ccde7dd385f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:42.495909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:42.499467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9d34716a-3090-4666-a7b7-5c6b2da8dd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:42.511026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 861/1698] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:42 2022] DELETE /identity/v3/projects/c7d5fe02473c4159843a9ccde7dd385f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:42.513138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb182e-ee50-4244-b761-407193ea5316 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.513138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb182e-ee50-4244-b761-407193ea5316 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.513138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb182e-ee50-4244-b761-407193ea5316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.563466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:42.565025 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2ceb182e-ee50-4244-b761-407193ea5316 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:42.566528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2ceb182e-ee50-4244-b761-407193ea5316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:42.609065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ed2f8-032d-497b-8570-6e8621ef8fe3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.616928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.617753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.619041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.619568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.620512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.623205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.638909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 838/1699] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:42.643038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.645035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:42.672703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaaf07-2676-4ebf-90a4-e1bdcce882b0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.682661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833c23a-ad4c-4252-b666-fca2c8392734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.684046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833c23a-ad4c-4252-b666-fca2c8392734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.684325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833c23a-ad4c-4252-b666-fca2c8392734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.684596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833c23a-ad4c-4252-b666-fca2c8392734 admin admin] PATH_INFO: `/v3/projects/5c73afa24d204f40a36e751b003ab9ad/users/8ed48cf7959d4e8b8e5ec3b0603bb30e/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.687829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833c23a-ad4c-4252-b666-fca2c8392734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c73afa24d204f40a36e751b003ab9ad, user_id=8ed48cf7959d4e8b8e5ec3b0603bb30e, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.692377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833c23a-ad4c-4252-b666-fca2c8392734 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.712880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 862/1700] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:42.723813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e79fa-7539-4c0d-a9c9-d4d697f5a299 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.724180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e79fa-7539-4c0d-a9c9-d4d697f5a299 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.724452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e79fa-7539-4c0d-a9c9-d4d697f5a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.738171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 839/1701] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:42 2022] PUT /identity/v3/projects/5c73afa24d204f40a36e751b003ab9ad/users/8ed48cf7959d4e8b8e5ec3b0603bb30e/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:42.740900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.741183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.741458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.797579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-788e79fa-7539-4c0d-a9c9-d4d697f5a299 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:42.798854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-788e79fa-7539-4c0d-a9c9-d4d697f5a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:42.844628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] MFA Rules not processed for user `8ed48cf7959d4e8b8e5ec3b0603bb30e`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:42.845606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:42.983006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 863/1702] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:42.983994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e79fa-7539-4c0d-a9c9-d4d697f5a299 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.002910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e79fa-7539-4c0d-a9c9-d4d697f5a299 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.015590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.016419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.016685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.016958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.019608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:43.019780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.021405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.040681 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 840/1703] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:43.041673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.044384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:43.058815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ef06c-07a8-45a7-9344-96d223680258 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.064665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 864/1704] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:43.064665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.068119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.068780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.069055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.069247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:43.069357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] PATH_INFO: `/v3/projects/bf4d1be0362c4d079229a4b5bba72e2d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.072814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4d1be0362c4d079229a4b5bba72e2d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.074966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.102275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:43.163156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4d1be0362c4d079229a4b5bba72e2d', 'request_id': 'req-57d43d7d-bb72-43a6-a6d7-1110d63c3847'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:43.171084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4d1be0362c4d079229a4b5bba72e2d', 'request_id': 'req-57d43d7d-bb72-43a6-a6d7-1110d63c3847'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:43.178335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4d1be0362c4d079229a4b5bba72e2d', 'request_id': 'req-57d43d7d-bb72-43a6-a6d7-1110d63c3847'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:43.203404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] The token cache is being invalidate because project bf4d1be0362c4d079229a4b5bba72e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:43.203778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:43.204802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:43.214566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 841/1705] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:43 2022] DELETE /identity/v3/projects/bf4d1be0362c4d079229a4b5bba72e2d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:43.219763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.224166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:43.225820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1a262-5886-40a4-b251-f1cd3533a20a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.318727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:43.359364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70558-45f6-400c-8433-432aa0d15ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.360220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70558-45f6-400c-8433-432aa0d15ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.360599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70558-45f6-400c-8433-432aa0d15ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.360997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70558-45f6-400c-8433-432aa0d15ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.363117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dce70558-45f6-400c-8433-432aa0d15ccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:43.383829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d43d7d-bb72-43a6-a6d7-1110d63c3847 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.397559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283f215-ba07-48b4-b68b-427bf7b2b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.398188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f215-ba07-48b4-b68b-427bf7b2b2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.399788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f215-ba07-48b4-b68b-427bf7b2b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.400075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283f215-ba07-48b4-b68b-427bf7b2b2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.400736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283f215-ba07-48b4-b68b-427bf7b2b2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.406592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283f215-ba07-48b4-b68b-427bf7b2b2c4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.482584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 842/1706] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:43 2022] POST /identity/v3/projects => generated 387 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:43.482584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e383ccd-98a3-4cd9-b499-6a0cdcead950 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.482584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e383ccd-98a3-4cd9-b499-6a0cdcead950 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.485260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e383ccd-98a3-4cd9-b499-6a0cdcead950 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.485460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 843/1707] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 05:29:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:43.494017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edbf27-cd7d-4964-afdf-2b559c65097d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.494150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edbf27-cd7d-4964-afdf-2b559c65097d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.494406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edbf27-cd7d-4964-afdf-2b559c65097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.560204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70558-45f6-400c-8433-432aa0d15ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.566350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-95edbf27-cd7d-4964-afdf-2b559c65097d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:43.568141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70558-45f6-400c-8433-432aa0d15ccb service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.573554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-95edbf27-cd7d-4964-afdf-2b559c65097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:43.613483 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 865/1708] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:43.615032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40531a2-dee5-4f13-a4d5-4391a28b2205 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.615319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40531a2-dee5-4f13-a4d5-4391a28b2205 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.615615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40531a2-dee5-4f13-a4d5-4391a28b2205 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.635220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 866/1709] 10.222.0.18 () {54 vars in 912 bytes} [Mon Sep 26 05:29:43 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:43.643230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40531a2-dee5-4f13-a4d5-4391a28b2205 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.799608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 844/1710] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:43.801329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a549b-17a8-43ae-a7b0-31c15effca2b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.801623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a549b-17a8-43ae-a7b0-31c15effca2b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.801899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a549b-17a8-43ae-a7b0-31c15effca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.884923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40531a2-dee5-4f13-a4d5-4391a28b2205 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.894773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2c2518-78dc-452b-9903-a08d6a7c6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.895503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c2518-78dc-452b-9903-a08d6a7c6e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.895906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c2518-78dc-452b-9903-a08d6a7c6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.896306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2c2518-78dc-452b-9903-a08d6a7c6e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.897849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c2518-78dc-452b-9903-a08d6a7c6e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.900966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2c2518-78dc-452b-9903-a08d6a7c6e02 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.935372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1c7a549b-17a8-43ae-a7b0-31c15effca2b None None] MFA Rules not processed for user `de2913a65aac4fda97bc92dbf15d3316`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:43.939213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1c7a549b-17a8-43ae-a7b0-31c15effca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:43.939908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 867/1711] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:43 2022] POST /identity/v3/users => generated 294 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:43.943188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c5f09-2484-449a-a6e5-592721fc17b8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.943323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c5f09-2484-449a-a6e5-592721fc17b8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.944544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c5f09-2484-449a-a6e5-592721fc17b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.978311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:44.000125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-db6c5f09-2484-449a-a6e5-592721fc17b8 None None] MFA Rules not processed for user `de2913a65aac4fda97bc92dbf15d3316`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:44.001402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-db6c5f09-2484-449a-a6e5-592721fc17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:44.039873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 845/1712] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:29:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:44.041819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882284a1-6c0f-48d3-8052-1f43554e2497 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.042590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882284a1-6c0f-48d3-8052-1f43554e2497 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.043038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882284a1-6c0f-48d3-8052-1f43554e2497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.071373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-882284a1-6c0f-48d3-8052-1f43554e2497 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:44.072952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-882284a1-6c0f-48d3-8052-1f43554e2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:44.087223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 846/1713] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:44.091276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882284a1-6c0f-48d3-8052-1f43554e2497 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.122438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882284a1-6c0f-48d3-8052-1f43554e2497 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.137074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 868/1714] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:29:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:44.138172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c5f09-2484-449a-a6e5-592721fc17b8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.148910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c5442-f039-4fae-87b0-3507a6d5fbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.149567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5442-f039-4fae-87b0-3507a6d5fbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.149828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5442-f039-4fae-87b0-3507a6d5fbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.150650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c5442-f039-4fae-87b0-3507a6d5fbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.151329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c5442-f039-4fae-87b0-3507a6d5fbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.153003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c5442-f039-4fae-87b0-3507a6d5fbc3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.154189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c5f09-2484-449a-a6e5-592721fc17b8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.161589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.162587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.162864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.163139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.165361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:44.165759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.168094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.188910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 847/1715] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:44.188910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e99c6-7201-419e-8442-ab8e8769e54a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.188910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e99c6-7201-419e-8442-ab8e8769e54a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.188910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e99c6-7201-419e-8442-ab8e8769e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.189745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 869/1716] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:44.191102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.193144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:44.211530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b502aa8-a9fb-4f80-ba7b-5eb01fd24edf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.219231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1a598-bef2-4853-9884-573246fa4d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.220031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a598-bef2-4853-9884-573246fa4d62 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.220757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a598-bef2-4853-9884-573246fa4d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.221036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1a598-bef2-4853-9884-573246fa4d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.236606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1a598-bef2-4853-9884-573246fa4d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.239913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1a598-bef2-4853-9884-573246fa4d62 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.248594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8f8e99c6-7201-419e-8442-ab8e8769e54a None None] MFA Rules not processed for user `bebd3b0bcdc04e77945fb9ddf8ca2d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:44.250230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8f8e99c6-7201-419e-8442-ab8e8769e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:44.254230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 870/1717] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:44.258106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066059c3-adac-4766-bf3d-1c72af76ec36 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.258403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066059c3-adac-4766-bf3d-1c72af76ec36 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.258674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066059c3-adac-4766-bf3d-1c72af76ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.306259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:44.314245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-066059c3-adac-4766-bf3d-1c72af76ec36 None None] MFA Rules not processed for user `aa1bc77ffe9245c8b1c8fa0ede1874b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:44.316708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-066059c3-adac-4766-bf3d-1c72af76ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:44.398502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 848/1718] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:44.399814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e99c6-7201-419e-8442-ab8e8769e54a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.410213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 871/1719] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:44.415469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066059c3-adac-4766-bf3d-1c72af76ec36 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.427266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e99c6-7201-419e-8442-ab8e8769e54a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.429947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066059c3-adac-4766-bf3d-1c72af76ec36 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.432059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.432875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.433281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.433706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.438465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.439576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.439866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.440142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.441337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.443587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.443850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.445404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.456775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 849/1720] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:44.457798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.459926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 872/1721] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:44.460943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.484687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db1da9-cbca-4652-9b4b-514dba95f4cb service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.495396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.496824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.497169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.498157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.498928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.502111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.600861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f62cb-6f86-46ff-b71a-c71524fcfdbc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.614576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 850/1722] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:44.616021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.623313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed48cf7959d4e8b8e5ec3b0603bb30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c73afa24d204f40a36e751b003ab9ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.626141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.626452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.626733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.628458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:44.628786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.632288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.689554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 873/1723] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:44.696221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.731071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437320ae-1d4a-4737-9479-fb05d5ff8069 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.749177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:44.819873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd487cf0-afdb-44a9-8ea4-ad88f717dc5a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.833287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.834899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.836380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.836893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] PATH_INFO: `/v3/projects/3152a73773e04e1ea498d8ac5db49282/users/05c07a7155e648a18fe1b029ba2f706d/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.838851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134d59c-fd69-42a2-9e9c-0d97663b37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.840899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d59c-fd69-42a2-9e9c-0d97663b37ae admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.842668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d59c-fd69-42a2-9e9c-0d97663b37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.843055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d59c-fd69-42a2-9e9c-0d97663b37ae admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.843866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134d59c-fd69-42a2-9e9c-0d97663b37ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.847315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134d59c-fd69-42a2-9e9c-0d97663b37ae admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.873595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3152a73773e04e1ea498d8ac5db49282, user_id=05c07a7155e648a18fe1b029ba2f706d, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:44.876604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:44.913494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 851/1724] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:44 2022] PUT /identity/v3/projects/3152a73773e04e1ea498d8ac5db49282/users/05c07a7155e648a18fe1b029ba2f706d/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:44.917977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.934190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 874/1725] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:44.935828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.936095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.936369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.997289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b3ce7-45dd-4ad6-860f-02e5bb8a9f09 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.004666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed48cf7959d4e8b8e5ec3b0603bb30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c73afa24d204f40a36e751b003ab9ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.005606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.005987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.006381 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.007170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.010331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.013583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] MFA Rules not processed for user `05c07a7155e648a18fe1b029ba2f706d`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:45.016280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:45.092583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 852/1726] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/projects => generated 354 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:45.093795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.121954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.206959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 875/1727] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:45.220182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.229178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:45.269757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fc7a3-a7db-4c9e-a5ab-7c25f7aa05cc tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.294038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.295092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.295376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.295705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.296371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.307051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.331776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 853/1728] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:45.332659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.359290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9a6de-2a25-4c6f-9db3-b9c270e134c5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.414323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.434463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b31a1-fff8-4476-866b-9e0bb7112951 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.440652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed48cf7959d4e8b8e5ec3b0603bb30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c73afa24d204f40a36e751b003ab9ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.441499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.442174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.442454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.443488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:45.443815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.446694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.456553 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.457211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.457763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.457886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.460228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:45.461142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 854/1729] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:45.462536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.465340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:45.551574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.553923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.569640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0ae93-2dca-4e3d-9a16-fd8869ffda67 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.577068 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 876/1730] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:45.577937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.583116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.583506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.583816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.584087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.587927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:45.588778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685de99-8ccd-4b20-97e5-b1967d647386 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.596412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce9ad6-5380-405b-9ac1-945a0e973652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.597165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce9ad6-5380-405b-9ac1-945a0e973652 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.597546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce9ad6-5380-405b-9ac1-945a0e973652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.597919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce9ad6-5380-405b-9ac1-945a0e973652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.598682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce9ad6-5380-405b-9ac1-945a0e973652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.604720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.604918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce9ad6-5380-405b-9ac1-945a0e973652 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.605160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.630961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 855/1731] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:45.631369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.641977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257fdcf-6212-4f3a-aada-496f6ad565ee service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.653127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.653825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.654472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.654589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.655884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.658687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.671084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 877/1732] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:45 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:45.677559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cd35-7088-4281-bc0e-d97b978a9add None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.677559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cd35-7088-4281-bc0e-d97b978a9add None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.677821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cd35-7088-4281-bc0e-d97b978a9add None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.683439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 878/1733] 10.222.0.18 () {54 vars in 961 bytes} [Mon Sep 26 05:29:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:45.684373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788cd35-7088-4281-bc0e-d97b978a9add None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.699738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 856/1734] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:45.701420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.746367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7f282-71ab-4ffc-929d-365323a3759d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.786187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.944003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de23db1-5015-4ea6-a31d-b1badf379c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.944835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de23db1-5015-4ea6-a31d-b1badf379c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.945987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de23db1-5015-4ea6-a31d-b1badf379c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.946414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de23db1-5015-4ea6-a31d-b1badf379c70 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.947225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de23db1-5015-4ea6-a31d-b1badf379c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.949889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de23db1-5015-4ea6-a31d-b1badf379c70 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:46.000512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 857/1735] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:45 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:46.007338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.007795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.007964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788cd35-7088-4281-bc0e-d97b978a9add None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.009002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.020044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ed48cf7959d4e8b8e5ec3b0603bb30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c73afa24d204f40a36e751b003ab9ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:46.020712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.020991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.021268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] PATH_INFO: `/v3/projects/c414580f226c42bd8fe91824265512c1` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.024095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c414580f226c42bd8fe91824265512c1)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:46.026046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:46.057387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:46.063248 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:46.164964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c414580f226c42bd8fe91824265512c1', 'request_id': 'req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:46.171253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:46.195705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c414580f226c42bd8fe91824265512c1', 'request_id': 'req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:46.212949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c414580f226c42bd8fe91824265512c1', 'request_id': 'req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:46.235252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] The token cache is being invalidate because project c414580f226c42bd8fe91824265512c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:46.235628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:46.243671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:46.245918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 879/1736] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:45 2022] DELETE /identity/v3/projects/c414580f226c42bd8fe91824265512c1 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:46.246708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.254092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:46.265402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 858/1737] 10.222.0.18 () {58 vars in 1058 bytes} [Mon Sep 26 05:29:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:46.267663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.271629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:46.328589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f5c3-4309-4c42-9ae7-afb849acabfb None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.489236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefd0c4-a5d4-48be-8eef-46b7a3c71087 tempest-VolumeQuotaClassesTest-1447009790 tempest-VolumeQuotaClassesTest-1447009790-project-admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.504054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:46.505659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.507564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.507953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:46.508357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] PATH_INFO: `/v3/projects/3e595ae8c50a4f6cadef1568693d3b4f/users/7fdfe0087740431794c46e10d8067170/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.509096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.512193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.512607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.513625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:46.518385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:46.562100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 859/1738] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:46.570142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.573388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e595ae8c50a4f6cadef1568693d3b4f, user_id=7fdfe0087740431794c46e10d8067170, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:46.584974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:46.629665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 880/1739] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:46 2022] PUT /identity/v3/projects/3e595ae8c50a4f6cadef1568693d3b4f/users/7fdfe0087740431794c46e10d8067170/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:46.632636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.725452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:46.788233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bccd9-0623-4f91-a078-c1901180ee4f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.906909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c8a9c-766f-4bfb-904a-fdb1beb03377 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.927791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa406ed-7754-4360-ae67-b428934a9502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:46.931738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa406ed-7754-4360-ae67-b428934a9502 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.932082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa406ed-7754-4360-ae67-b428934a9502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.932410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa406ed-7754-4360-ae67-b428934a9502 admin admin] PATH_INFO: `/v3/projects/4809aa6ebf904156a1c94b58ece32eeb/users/3d81726649274dd29407e8c385e80034/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.998186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa406ed-7754-4360-ae67-b428934a9502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4809aa6ebf904156a1c94b58ece32eeb, user_id=3d81726649274dd29407e8c385e80034, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.002750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa406ed-7754-4360-ae67-b428934a9502 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.014056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.014802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.015181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.015995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.023347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.045164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 881/1740] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:46 2022] PUT /identity/v3/projects/4809aa6ebf904156a1c94b58ece32eeb/users/3d81726649274dd29407e8c385e80034/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:47.047264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792edc7-5bdd-408c-848f-65f203c3da55 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.047391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792edc7-5bdd-408c-848f-65f203c3da55 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.047720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792edc7-5bdd-408c-848f-65f203c3da55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.062640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.064321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.116018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 860/1741] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:47.120403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.125270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.137149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2792edc7-5bdd-408c-848f-65f203c3da55 None None] MFA Rules not processed for user `7fdfe0087740431794c46e10d8067170`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:47.140839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2792edc7-5bdd-408c-848f-65f203c3da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.160374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75990efb-9ae3-4584-bae9-477ecf4c82a8 service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.229187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:47.306013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 882/1742] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:47.307264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792edc7-5bdd-408c-848f-65f203c3da55 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.312312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.312993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.313269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.313713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] PATH_INFO: `/v3/users/247c2c2a1c3743bcabf2906b239bf131` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.315530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247c2c2a1c3743bcabf2906b239bf131)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.321276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.332760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792edc7-5bdd-408c-848f-65f203c3da55 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.344272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.345194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.345626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.346048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.347362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.354746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.409925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 883/1743] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:47.410919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.441208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247c2c2a1c3743bcabf2906b239bf131'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:47.442113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22fbf18-f3f5-4ae2-8a94-9df9a969fe85 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.456229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.456827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.457106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.457719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.458610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.462595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.465050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247c2c2a1c3743bcabf2906b239bf131'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:47.506003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247c2c2a1c3743bcabf2906b239bf131'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:47.507777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247c2c2a1c3743bcabf2906b239bf131'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:47.513945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:47.551063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247c2c2a1c3743bcabf2906b239bf131'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:47.570825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 884/1744] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:47 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:47.571806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.579057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.584033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 861/1745] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:47 2022] DELETE /identity/v3/users/247c2c2a1c3743bcabf2906b239bf131 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:47.585093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.590266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.750359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5827ce-1e89-4eb9-b151-72ebd77f6ab2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.763652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c66f3d-7b1d-4c3f-9dc4-081c78ddcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.764936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66f3d-7b1d-4c3f-9dc4-081c78ddcffe admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.766126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66f3d-7b1d-4c3f-9dc4-081c78ddcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.767275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66f3d-7b1d-4c3f-9dc4-081c78ddcffe admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.768192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c66f3d-7b1d-4c3f-9dc4-081c78ddcffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.774934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c66f3d-7b1d-4c3f-9dc4-081c78ddcffe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.786053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642c07c-5036-4f61-ba9f-2b15616a08f5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.798617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f1305-4399-4806-b556-082f5d86463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.799359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1305-4399-4806-b556-082f5d86463a admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.799668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1305-4399-4806-b556-082f5d86463a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.799967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f1305-4399-4806-b556-082f5d86463a admin admin] PATH_INFO: `/v3/projects/4809aa6ebf904156a1c94b58ece32eeb/users/3d81726649274dd29407e8c385e80034/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.803228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f1305-4399-4806-b556-082f5d86463a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4809aa6ebf904156a1c94b58ece32eeb, user_id=3d81726649274dd29407e8c385e80034, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.810158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f1305-4399-4806-b556-082f5d86463a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.831534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 862/1746] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:47 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:47.835110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25d68a-cea7-4f35-870e-ebe6b5cfaaf0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.837433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25d68a-cea7-4f35-870e-ebe6b5cfaaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.837730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25d68a-cea7-4f35-870e-ebe6b5cfaaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.840998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 885/1747] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:47 2022] PUT /identity/v3/projects/4809aa6ebf904156a1c94b58ece32eeb/users/3d81726649274dd29407e8c385e80034/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:47.844295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533d51-9bee-4abc-9f3e-941953ddc3de None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.845394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533d51-9bee-4abc-9f3e-941953ddc3de None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.847428 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533d51-9bee-4abc-9f3e-941953ddc3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.905991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0f25d68a-cea7-4f35-870e-ebe6b5cfaaf0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:47.908823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-98533d51-9bee-4abc-9f3e-941953ddc3de None None] MFA Rules not processed for user `14edcf1140f840679b671523b5c29d38`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:47.910605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0f25d68a-cea7-4f35-870e-ebe6b5cfaaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.912162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-98533d51-9bee-4abc-9f3e-941953ddc3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:48.109436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 886/1748] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:48.119117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533d51-9bee-4abc-9f3e-941953ddc3de None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.141808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 863/1749] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:48.143464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe6fdd-c228-4b02-b793-4f37cec267d2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.143777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe6fdd-c228-4b02-b793-4f37cec267d2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.144055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe6fdd-c228-4b02-b793-4f37cec267d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.209726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533d51-9bee-4abc-9f3e-941953ddc3de None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.238437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.239077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.239356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.240309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.240998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.242600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.262162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 887/1750] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:48.266671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.273683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:48.287482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0cbe6fdd-c228-4b02-b793-4f37cec267d2 None None] MFA Rules not processed for user `3d81726649274dd29407e8c385e80034`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:48.290295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0cbe6fdd-c228-4b02-b793-4f37cec267d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:48.369507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:48.431875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9c47-263d-4f2b-9195-465cd113bd12 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.442110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.443032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.443313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.443618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.456397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.457845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.459385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 864/1751] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:48.460300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe6fdd-c228-4b02-b793-4f37cec267d2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.468936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:48.475064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe6fdd-c228-4b02-b793-4f37cec267d2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.475777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 888/1752] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:48.477178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.478377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:48.487283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.487283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.487779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.487951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] PATH_INFO: `/v3/projects/dbbb91d3e6fb4f80bea9906bdb84ef0e/users/ac3bca8d7ef94caa95861dc0ee393447/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.527627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbb91d3e6fb4f80bea9906bdb84ef0e, user_id=ac3bca8d7ef94caa95861dc0ee393447, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.533128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.577591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 865/1753] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:48 2022] PUT /identity/v3/projects/dbbb91d3e6fb4f80bea9906bdb84ef0e/users/ac3bca8d7ef94caa95861dc0ee393447/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:48.578964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.594008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd41b9a-2b29-451d-b518-56ba805e3207 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.734718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252755c-3ae6-4da3-8031-81bf61cc3ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.735496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252755c-3ae6-4da3-8031-81bf61cc3ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.735800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252755c-3ae6-4da3-8031-81bf61cc3ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.736140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252755c-3ae6-4da3-8031-81bf61cc3ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.760815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36794594-c093-484f-97f5-4ce0c996a462 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.769460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.770334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.770630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.770905 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.771986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.773769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.824759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 866/1754] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:48.831071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.865241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50d4af-e2e4-4041-9b00-584bac9cd3ac admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.879218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.880104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.881677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.882074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] PATH_INFO: `/v3/projects/dbbb91d3e6fb4f80bea9906bdb84ef0e/users/ac3bca8d7ef94caa95861dc0ee393447/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.886709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbbb91d3e6fb4f80bea9906bdb84ef0e, user_id=ac3bca8d7ef94caa95861dc0ee393447, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.897880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252755c-3ae6-4da3-8031-81bf61cc3ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.900980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252755c-3ae6-4da3-8031-81bf61cc3ee6 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.901973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.933250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 889/1756] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:48.942096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae9ea-9bdd-4bbc-ac3d-ba2b854efede None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.942409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae9ea-9bdd-4bbc-ac3d-ba2b854efede None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.945140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae9ea-9bdd-4bbc-ac3d-ba2b854efede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.947765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 867/1756] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:48 2022] PUT /identity/v3/projects/dbbb91d3e6fb4f80bea9906bdb84ef0e/users/ac3bca8d7ef94caa95861dc0ee393447/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:49.079287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-308ae9ea-9bdd-4bbc-ac3d-ba2b854efede None None] MFA Rules not processed for user `ac3bca8d7ef94caa95861dc0ee393447`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:49.082708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-308ae9ea-9bdd-4bbc-ac3d-ba2b854efede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:49.107719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:49.204546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:49.234699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e723de-2cc8-44eb-a9dc-7dbfcfc90643 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:49.243174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:49.244221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.245348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.245800 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] PATH_INFO: `/v3/users/05c07a7155e648a18fe1b029ba2f706d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.247702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c07a7155e648a18fe1b029ba2f706d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:49.250403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:49.370569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 890/1757] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:49.385019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae9ea-9bdd-4bbc-ac3d-ba2b854efede None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:49.420850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c07a7155e648a18fe1b029ba2f706d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:49.447258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c07a7155e648a18fe1b029ba2f706d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:49.479457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:49.494805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c07a7155e648a18fe1b029ba2f706d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:49.495697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c07a7155e648a18fe1b029ba2f706d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:49.510995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-862d8457-64a6-45b2-846e-40045ed6b204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c07a7155e648a18fe1b029ba2f706d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:49.534462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 868/1758] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:49 2022] DELETE /identity/v3/users/05c07a7155e648a18fe1b029ba2f706d => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:29:49.538268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.538568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.538840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.613560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:49.615156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:49.657547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae9ea-9bdd-4bbc-ac3d-ba2b854efede None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:49.759606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 869/1759] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:49.783857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:49.784743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.785200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.785605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.787518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:49.820095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:49.823162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:49.923222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:49.925008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:50.030778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 891/1760] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:29:50.103333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d300b92-e79c-4332-9864-4b0e97926142 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.120001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:50.120652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.120932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.126688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.136664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:50.139302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:50.178526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93942058-2325-456b-b3ac-47e35b3e3ed6 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.192230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:50.193565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.194122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.194611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] PATH_INFO: `/v3/projects/e0af1df7586b4ef1b50ba77bccef2928` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.196613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0af1df7586b4ef1b50ba77bccef2928)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:50.199392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:50.201395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:50.204051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:50.251882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 870/1761] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:50.343452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:50.411677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0af1df7586b4ef1b50ba77bccef2928', 'request_id': 'req-973ea583-6b25-4d11-865f-82a9fa1c6ecf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.437349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0af1df7586b4ef1b50ba77bccef2928', 'request_id': 'req-973ea583-6b25-4d11-865f-82a9fa1c6ecf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.451044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0af1df7586b4ef1b50ba77bccef2928', 'request_id': 'req-973ea583-6b25-4d11-865f-82a9fa1c6ecf'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.479315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] The token cache is being invalidate because project e0af1df7586b4ef1b50ba77bccef2928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:50.480275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.484119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-973ea583-6b25-4d11-865f-82a9fa1c6ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.492615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 892/1762] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:50 2022] DELETE /identity/v3/projects/e0af1df7586b4ef1b50ba77bccef2928 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:50.497526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:50.523133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a2b88-bb84-4d0a-b047-ae58b6c4917c service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.548371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d7eaa-5161-456e-bf8b-989c2d983024 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.548754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d7eaa-5161-456e-bf8b-989c2d983024 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.548945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d7eaa-5161-456e-bf8b-989c2d983024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.612592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4d0d7eaa-5161-456e-bf8b-989c2d983024 None None] MFA Rules not processed for user `dbd7677320d549a4bd492fa00a071f19`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:50.661858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4d0d7eaa-5161-456e-bf8b-989c2d983024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:50.699285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:50.700412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.700980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.701422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] PATH_INFO: `/v3/users/8ed48cf7959d4e8b8e5ec3b0603bb30e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.702840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed48cf7959d4e8b8e5ec3b0603bb30e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:50.706044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:50.800006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:50.833270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed48cf7959d4e8b8e5ec3b0603bb30e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.862882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed48cf7959d4e8b8e5ec3b0603bb30e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.901879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed48cf7959d4e8b8e5ec3b0603bb30e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.903861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed48cf7959d4e8b8e5ec3b0603bb30e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.916677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed48cf7959d4e8b8e5ec3b0603bb30e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:50.919727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 893/1763] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:50.921071 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.921355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.921630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.949835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 871/1764] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:50 2022] DELETE /identity/v3/users/8ed48cf7959d4e8b8e5ec3b0603bb30e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:51.173301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:51.174914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:51.345220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 894/1765] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:29:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:51.660771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.662422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:51.990918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.994412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:52.063613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2132f-0f39-4fd1-8734-a33147d3e991 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:52.075010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbc2b1-cdeb-4632-abf7-0dcc839ad0bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.075733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbc2b1-cdeb-4632-abf7-0dcc839ad0bf service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.076019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbc2b1-cdeb-4632-abf7-0dcc839ad0bf service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.076314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbc2b1-cdeb-4632-abf7-0dcc839ad0bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.081924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:52.098429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbc2b1-cdeb-4632-abf7-0dcc839ad0bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:52.100181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbc2b1-cdeb-4632-abf7-0dcc839ad0bf service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:52.120172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 872/1766] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:29:52.159807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432f16d-e7ed-4524-9bc2-beeac8a7e144 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:52.177190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.178113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.178584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.179052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] PATH_INFO: `/v3/projects/5c73afa24d204f40a36e751b003ab9ad` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.183660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c73afa24d204f40a36e751b003ab9ad)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:52.186090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:52.298089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c73afa24d204f40a36e751b003ab9ad', 'request_id': 'req-269fa3cb-7ee0-423f-a34d-b208b78f01ac'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:52.319278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c73afa24d204f40a36e751b003ab9ad', 'request_id': 'req-269fa3cb-7ee0-423f-a34d-b208b78f01ac'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:52.370453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c73afa24d204f40a36e751b003ab9ad', 'request_id': 'req-269fa3cb-7ee0-423f-a34d-b208b78f01ac'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:52.406392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] The token cache is being invalidate because project 5c73afa24d204f40a36e751b003ab9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:52.408365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:52.421844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-269fa3cb-7ee0-423f-a34d-b208b78f01ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:52.427657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 895/1767] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:51 2022] DELETE /identity/v3/projects/5c73afa24d204f40a36e751b003ab9ad => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:52.433423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d2aa-de8c-440d-b53a-388df2985bf3 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.434102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d2aa-de8c-440d-b53a-388df2985bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.435154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d2aa-de8c-440d-b53a-388df2985bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.487431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5e06d2aa-de8c-440d-b53a-388df2985bf3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:52.492412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5e06d2aa-de8c-440d-b53a-388df2985bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:52.771475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 873/1768] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:52.781575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faed861-62af-42f2-9dd3-fcdecc4490d9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.782142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faed861-62af-42f2-9dd3-fcdecc4490d9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.782535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faed861-62af-42f2-9dd3-fcdecc4490d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.887226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5faed861-62af-42f2-9dd3-fcdecc4490d9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:52.890414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5faed861-62af-42f2-9dd3-fcdecc4490d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:52.924675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06d2aa-de8c-440d-b53a-388df2985bf3 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:52.939194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 896/1769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:52.949502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06d2aa-de8c-440d-b53a-388df2985bf3 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:52.967303 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.968943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.970375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.970660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.978401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:52.978739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:52.986290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.018129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 874/1770] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:53.022735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faed861-62af-42f2-9dd3-fcdecc4490d9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.033660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faed861-62af-42f2-9dd3-fcdecc4490d9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.049580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.054240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.055042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.055669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.056567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.058972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.126946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 897/1771] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:53 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:29:53.128374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.136290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:53.150830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942c5e1-785f-467b-9081-e8ed69947b0c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.276240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.280361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:53.334121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.336851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.337825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.338258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.343703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.349423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.417013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 875/1772] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:53 2022] POST /identity/v3/users => generated 296 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:53.423520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.483096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff692418-df1d-439e-a985-3754358a18db admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.509490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.512044 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.512324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.512589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.518213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.526706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.579459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 876/1773] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:53.583741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.593991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee9a1-a243-4a1e-8707-0213e8eaf289 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.605517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303b7ca-053c-4e23-af3e-a85bf2e4f1b9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.620310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.621143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.621390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.621704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.622487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.629261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.636141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.639764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.642893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.644093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] PATH_INFO: `/v3/projects/3152a73773e04e1ea498d8ac5db49282` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.665164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3152a73773e04e1ea498d8ac5db49282)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.670723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 877/1774] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:29:53.675872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.686045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.703008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaa9dc-7b66-41cf-a06d-1a3a42b5ba4e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.731169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c875e-dd5b-4127-a27f-d408a1704718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.735204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c875e-dd5b-4127-a27f-d408a1704718 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.736114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c875e-dd5b-4127-a27f-d408a1704718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.744969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c875e-dd5b-4127-a27f-d408a1704718 admin admin] PATH_INFO: `/v3/projects/559e9c8ef563427eb8f7a93a1ff34747/users/668658418b2b41e985963cd40d1aa4c1/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.807054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c875e-dd5b-4127-a27f-d408a1704718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=559e9c8ef563427eb8f7a93a1ff34747, user_id=668658418b2b41e985963cd40d1aa4c1, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.813647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c875e-dd5b-4127-a27f-d408a1704718 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.879659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:53.895121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 878/1775] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:53 2022] PUT /identity/v3/projects/559e9c8ef563427eb8f7a93a1ff34747/users/668658418b2b41e985963cd40d1aa4c1/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:29:53.903469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.903930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.904321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.915947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3152a73773e04e1ea498d8ac5db49282', 'request_id': 'req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:53.946517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3152a73773e04e1ea498d8ac5db49282', 'request_id': 'req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:53.980314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3152a73773e04e1ea498d8ac5db49282', 'request_id': 'req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.032198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] MFA Rules not processed for user `668658418b2b41e985963cd40d1aa4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:54.047834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:54.048991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] The token cache is being invalidate because project 3152a73773e04e1ea498d8ac5db49282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:54.049491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.054185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.063335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 898/1776] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:53 2022] DELETE /identity/v3/projects/3152a73773e04e1ea498d8ac5db49282 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:54.064699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:54.066116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:54.290035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb6182-cf6a-4ea9-b8fa-ffe68e7ae459 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:54.341986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:54.342759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:54.343113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:54.343430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] PATH_INFO: `/v3/users/3d81726649274dd29407e8c385e80034` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:54.365747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d81726649274dd29407e8c385e80034)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:54.375054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:54.415783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 879/1777] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:54.416861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:54.419413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:54.505639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e777cad-fb7f-4e9e-abfd-8a4e9fcd6471 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:54.526751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:54.529829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:54.536433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:54.537828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] PATH_INFO: `/v3/users/7fdfe0087740431794c46e10d8067170` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:54.545575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fdfe0087740431794c46e10d8067170)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:54.573946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d81726649274dd29407e8c385e80034'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.576653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:54.608345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d81726649274dd29407e8c385e80034'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.609000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d81726649274dd29407e8c385e80034'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.628109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d81726649274dd29407e8c385e80034'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.684295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d81726649274dd29407e8c385e80034'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.716828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 899/1778] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:54 2022] DELETE /identity/v3/users/3d81726649274dd29407e8c385e80034 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:54.722283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:54.729035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:54.762702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:54.779183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fdfe0087740431794c46e10d8067170'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.808133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fdfe0087740431794c46e10d8067170'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.844073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fdfe0087740431794c46e10d8067170'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.845007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fdfe0087740431794c46e10d8067170'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.864496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-324c185f-45bf-4e2b-937a-e51fd6c8e0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fdfe0087740431794c46e10d8067170'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:54.879405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 880/1779] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:54 2022] DELETE /identity/v3/users/7fdfe0087740431794c46e10d8067170 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:54.911018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c0051-191f-4320-b497-952f743b43a4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:54.911940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c0051-191f-4320-b497-952f743b43a4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:54.913263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c0051-191f-4320-b497-952f743b43a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.028933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0c8c0051-191f-4320-b497-952f743b43a4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:55.032192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0c8c0051-191f-4320-b497-952f743b43a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:55.052716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:55.150496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b91ab-a141-428b-8bdf-de8d963bceca admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:55.194205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 881/1780] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:55.195871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.199191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.199191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.261347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] MFA Rules not processed for user `de2913a65aac4fda97bc92dbf15d3316`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:55.262688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:55.305642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:55.306822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.307633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.308236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.309151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:55.314462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:55.425522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 900/1781] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:54 2022] POST /identity/v3/projects => generated 393 bytes in 708 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:55.432373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:55.468306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 882/1782] 10.222.0.48 () {58 vars in 1015 bytes} [Mon Sep 26 05:29:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:55.469359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:55.470234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:55.476988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:55.532584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6a0f1-1917-45a9-bb07-c5df8502a263 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:55.750499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563e89a-81ed-4030-a922-5d0ebcc9d4dd admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:55.768220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:55.769043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.769410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.769955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.785872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:55.825979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:55.847790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.848235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.848705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.849539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:55.859527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:55.926255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 883/1783] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:55 2022] POST /identity/v3/users => generated 303 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:55.927595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:55.934228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:55.976262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2cfff-0ff0-4aef-9656-17ae77dd1ac2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.000947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.001721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.002014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.002288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.021006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.025325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.053549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 884/1784] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:56.055103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.058422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.063764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.071058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b44322-ef72-4b86-a7eb-a6acfe734360 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.076881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.077997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.078483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.079006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.079985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.082077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.094317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 885/1785] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:56.095716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 901/1786] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:56.101037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.121181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff72186-6397-4bec-9fd9-7c33f8327711 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.130178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.132184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.132955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.133674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] PATH_INFO: `/v3/projects/064e490c375e41f18dc5d45b754ffbd6/users/f5c3c5c13cb640f7bea661098a7c1527/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.161651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064e490c375e41f18dc5d45b754ffbd6, user_id=f5c3c5c13cb640f7bea661098a7c1527, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.166437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.196831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 886/1787] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:56 2022] PUT /identity/v3/projects/064e490c375e41f18dc5d45b754ffbd6/users/f5c3c5c13cb640f7bea661098a7c1527/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:56.201099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.223310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b923be9-648b-4d51-a9a1-7a885f81ca02 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.290146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:56.357971 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c0792-7798-4db3-bbcf-4077e2e618e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.358648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0792-7798-4db3-bbcf-4077e2e618e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.358926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0792-7798-4db3-bbcf-4077e2e618e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.360026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c0792-7798-4db3-bbcf-4077e2e618e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.360893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c0792-7798-4db3-bbcf-4077e2e618e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.383176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c0792-7798-4db3-bbcf-4077e2e618e3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.404235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 902/1788] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:56.408069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.423079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4a220-148c-4d14-a8fa-4cbdd292cae9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.440570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.442273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.442273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.442935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] PATH_INFO: `/v3/projects/064e490c375e41f18dc5d45b754ffbd6/users/f5c3c5c13cb640f7bea661098a7c1527/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.458410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=064e490c375e41f18dc5d45b754ffbd6, user_id=f5c3c5c13cb640f7bea661098a7c1527, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.462375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.518075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 887/1789] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:56 2022] PUT /identity/v3/projects/064e490c375e41f18dc5d45b754ffbd6/users/f5c3c5c13cb640f7bea661098a7c1527/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:56.530172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.530817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.531425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.604842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] MFA Rules not processed for user `f5c3c5c13cb640f7bea661098a7c1527`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:56.606900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:56.763219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 903/1790] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:56.775449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.777526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:56.979501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58301791-dbb9-4d57-af62-0ba6c274a46e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.983968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.985257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.985723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.986079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.005358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.008416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:57.052030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 888/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:57.161341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:57.163399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:57.186860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ad2d-1b5e-474b-ab8e-92776b62324b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.208103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f1479-b165-40dd-af04-df3c7973913c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.209043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1479-b165-40dd-af04-df3c7973913c service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.209565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1479-b165-40dd-af04-df3c7973913c service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.210058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f1479-b165-40dd-af04-df3c7973913c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.218599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2f6f1479-b165-40dd-af04-df3c7973913c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:57.515964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f1479-b165-40dd-af04-df3c7973913c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.517642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f1479-b165-40dd-af04-df3c7973913c service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:57.533264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 904/1792] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:29:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:29:57.711400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:57.715446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:57.953670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5209429-32c9-49bb-9030-f1e3b29a64ee service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.961321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.962019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.962282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.962559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] PATH_INFO: `/v3/projects/4809aa6ebf904156a1c94b58ece32eeb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.964245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4809aa6ebf904156a1c94b58ece32eeb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.966349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:58.082393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:58.151815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4809aa6ebf904156a1c94b58ece32eeb', 'request_id': 'req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:58.172507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4809aa6ebf904156a1c94b58ece32eeb', 'request_id': 'req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:58.200609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4809aa6ebf904156a1c94b58ece32eeb', 'request_id': 'req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:58.233770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] The token cache is being invalidate because project 4809aa6ebf904156a1c94b58ece32eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:58.234150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:58.234917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8ea1b91c-4cda-420e-b5f4-053edfe37bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:58.239832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 889/1793] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:57 2022] DELETE /identity/v3/projects/4809aa6ebf904156a1c94b58ece32eeb => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:58.246178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f6897-76a2-447b-a36a-5c16f7649471 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.247340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f6897-76a2-447b-a36a-5c16f7649471 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.248090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f6897-76a2-447b-a36a-5c16f7649471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.314907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8a1f6897-76a2-447b-a36a-5c16f7649471 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:58.316268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8a1f6897-76a2-447b-a36a-5c16f7649471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:58.433539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:58.485836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 905/1794] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:29:58.487390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ca90d-2046-4c77-896a-aa524233bd98 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.487741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ca90d-2046-4c77-896a-aa524233bd98 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.487980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ca90d-2046-4c77-896a-aa524233bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.566166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a73ca90d-2046-4c77-896a-aa524233bd98 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:58.569748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a73ca90d-2046-4c77-896a-aa524233bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:58.600553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 890/1795] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:29:58.605745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f6897-76a2-447b-a36a-5c16f7649471 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:58.630867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f6897-76a2-447b-a36a-5c16f7649471 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:58.658537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:58.659697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.660217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.660693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.661723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:58.662231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:58.664102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:58.715943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 906/1796] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:58.719308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ca90d-2046-4c77-896a-aa524233bd98 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:58.750997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ca90d-2046-4c77-896a-aa524233bd98 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:58.760247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:58.763056 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:58.765099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:58.766132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.766420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.767301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.768358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:58.772324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:58.809504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc1efc-e26c-48b4-82da-2f5bc97aac57 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:58.825637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:58.826211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.826762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.827131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] PATH_INFO: `/v3/projects/3e595ae8c50a4f6cadef1568693d3b4f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.830406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e595ae8c50a4f6cadef1568693d3b4f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:58.832508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:58.834335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 891/1797] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:29:58 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:29:58.839982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:58.953345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74fcdd-3201-4782-abee-c32803da3689 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.003241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e595ae8c50a4f6cadef1568693d3b4f', 'request_id': 'req-ad33ec3b-fb0c-44ee-8af3-333e409530dc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.028572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e595ae8c50a4f6cadef1568693d3b4f', 'request_id': 'req-ad33ec3b-fb0c-44ee-8af3-333e409530dc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.045202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e595ae8c50a4f6cadef1568693d3b4f', 'request_id': 'req-ad33ec3b-fb0c-44ee-8af3-333e409530dc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.087295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] The token cache is being invalidate because project 3e595ae8c50a4f6cadef1568693d3b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:29:59.087861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.090129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.098350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 907/1798] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:29:58 2022] DELETE /identity/v3/projects/3e595ae8c50a4f6cadef1568693d3b4f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:59.104826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.107070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:59.245832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.249670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.251245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.251245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.253291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:59.260014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:59.337950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33ec3b-fb0c-44ee-8af3-333e409530dc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.361161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.362026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.362534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.363057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] PATH_INFO: `/v3/users/ac3bca8d7ef94caa95861dc0ee393447` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.367250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3bca8d7ef94caa95861dc0ee393447)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:59.371240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:59.379197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 892/1799] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:29:58 2022] POST /identity/v3/users => generated 291 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:59.380316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.384541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:59.421139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a3243-2ee7-452f-b3b4-6e070494107b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.467424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.470703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.471214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.471496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.472229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:59.493655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:59.553099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 893/1800] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:59.554091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.636537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836d62c-30d1-48ae-8905-11cb94a75074 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.643073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3bca8d7ef94caa95861dc0ee393447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.664686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.668223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.674021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.674021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.678999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:59.687305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3bca8d7ef94caa95861dc0ee393447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.688955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3bca8d7ef94caa95861dc0ee393447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.690349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:59.697484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:59.736204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 894/1801] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:29:59.738188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.742822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:59.752075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3bca8d7ef94caa95861dc0ee393447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.770274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:59.797398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b232-aee6-4029-ba9f-5a7e2967a5af admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.818015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.818929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.819393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.819831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] PATH_INFO: `/v3/projects/0a21059086694bbbaf3f37c7ce32043d/users/e3e19dceb1474993ba41e6420045a60d/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.841456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6852f11-6151-43b4-9656-6d317725648f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3bca8d7ef94caa95861dc0ee393447'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:29:59.869888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 908/1802] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:29:59 2022] DELETE /identity/v3/users/ac3bca8d7ef94caa95861dc0ee393447 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:59.872617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a21059086694bbbaf3f37c7ce32043d, user_id=e3e19dceb1474993ba41e6420045a60d, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:59.875379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:59.899367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 895/1803] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:29:59 2022] PUT /identity/v3/projects/0a21059086694bbbaf3f37c7ce32043d/users/e3e19dceb1474993ba41e6420045a60d/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:59.910167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f42b0-4645-4e20-9ffe-301f0e385321 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.910654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f42b0-4645-4e20-9ffe-301f0e385321 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.911084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f42b0-4645-4e20-9ffe-301f0e385321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.072223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f86f42b0-4645-4e20-9ffe-301f0e385321 None None] MFA Rules not processed for user `e3e19dceb1474993ba41e6420045a60d`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:00.076532 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f86f42b0-4645-4e20-9ffe-301f0e385321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:00.340231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 909/1804] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:29:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:00.343172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:00.532023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190df39-0df7-4345-9381-14a42716dafb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.544127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.544771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.545048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.545314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.545957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.547935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.609156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 896/1805] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:00 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:00.610201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f42b0-4645-4e20-9ffe-301f0e385321 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:00.633313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f42b0-4645-4e20-9ffe-301f0e385321 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.877227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.878332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.878923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.879427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.882133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.884816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.967137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 910/1806] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:00 2022] POST /identity/v3/users => generated 297 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:00.971238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:01.020411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f46420-2bd7-46cb-9e28-620e7ca720a9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:01.042485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:01.048592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:01.049247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:01.049722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:01.052393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:01.059469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:01.106402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:01.110333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 897/1807] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:01.122868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f83c68-88de-4dcd-9c9f-858a444057a9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:01.134492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:01.136271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:01.136546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:01.136827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] PATH_INFO: `/v3/projects/9353567e748c4ba485c8cba229fa3360/users/d961dbe645ea4b2abc1741b8a6fc1af3/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:01.176450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9353567e748c4ba485c8cba229fa3360, user_id=d961dbe645ea4b2abc1741b8a6fc1af3, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:01.179730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:01.215255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 911/1808] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:01 2022] PUT /identity/v3/projects/9353567e748c4ba485c8cba229fa3360/users/d961dbe645ea4b2abc1741b8a6fc1af3/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:01.219428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:01.240389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eeb273-5573-4079-b94f-f8e9590a08f6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:01.404435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36d203-db0e-4083-8bc4-7012a4e690b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:01.405159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d203-db0e-4083-8bc4-7012a4e690b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:01.405442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d203-db0e-4083-8bc4-7012a4e690b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:01.405709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36d203-db0e-4083-8bc4-7012a4e690b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:01.408948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36d203-db0e-4083-8bc4-7012a4e690b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:01.410955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36d203-db0e-4083-8bc4-7012a4e690b4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:01.446560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 898/1809] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:01.451374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:01.471352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5c24c-6b91-4496-ba61-2cac5ad2f1aa admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:01.482607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:01.483576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:01.484073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:01.485359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] PATH_INFO: `/v3/projects/9353567e748c4ba485c8cba229fa3360/users/d961dbe645ea4b2abc1741b8a6fc1af3/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:01.490132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9353567e748c4ba485c8cba229fa3360, user_id=d961dbe645ea4b2abc1741b8a6fc1af3, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:01.498038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:01.529893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 912/1810] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:01 2022] PUT /identity/v3/projects/9353567e748c4ba485c8cba229fa3360/users/d961dbe645ea4b2abc1741b8a6fc1af3/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:01.554272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:01.556061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:01.556912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:01.642660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] MFA Rules not processed for user `d961dbe645ea4b2abc1741b8a6fc1af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:01.647338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:01.813236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:01.911205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 899/1811] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:01.921545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:01.923934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:01.976061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:02.094307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210136ce-a903-4398-bf4b-3fcf12bb803f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:02.099111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:02.099894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:02.100388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:02.100657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:02.116442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:02.154769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:02.203673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 913/1812] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:03.073232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:03.080452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:03.184734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:03.302504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd31d5-fa3d-44af-b91f-5b3274f3db5c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:03.324543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:03.325559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:03.325883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:03.326155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] PATH_INFO: `/v3/users/668658418b2b41e985963cd40d1aa4c1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:03.330684 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=668658418b2b41e985963cd40d1aa4c1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:03.334110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:03.423527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097016a-e82d-428d-9fa2-ecc8ff620c4b service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:03.440048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:03.441091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:03.442079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:03.443322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] PATH_INFO: `/v3/users/e3e19dceb1474993ba41e6420045a60d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:03.445576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e19dceb1474993ba41e6420045a60d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:03.457241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:03.501096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668658418b2b41e985963cd40d1aa4c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.527685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668658418b2b41e985963cd40d1aa4c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.561392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668658418b2b41e985963cd40d1aa4c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.565634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668658418b2b41e985963cd40d1aa4c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.587212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e19dceb1474993ba41e6420045a60d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.593813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3cdd8413-7342-4b24-b5a7-7b41074a2858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668658418b2b41e985963cd40d1aa4c1'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.605115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e19dceb1474993ba41e6420045a60d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.605739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e19dceb1474993ba41e6420045a60d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.617221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 900/1813] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:03 2022] DELETE /identity/v3/users/668658418b2b41e985963cd40d1aa4c1 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:03.624267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e19dceb1474993ba41e6420045a60d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.625838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ae564-d7ee-47ff-b1b5-6a0855276577 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:03.627951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ae564-d7ee-47ff-b1b5-6a0855276577 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:03.628377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ae564-d7ee-47ff-b1b5-6a0855276577 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:03.633906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 901/1814] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:30:03 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:03.637059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a3a4-56d7-4160-acbd-9854d36c5cdb None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:03.639532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a3a4-56d7-4160-acbd-9854d36c5cdb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:03.640812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44a3a4-56d7-4160-acbd-9854d36c5cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:03.655381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8f4b4d56-a6c5-41ee-9ae6-2d789c2a2265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e19dceb1474993ba41e6420045a60d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:03.665835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 914/1815] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:03 2022] DELETE /identity/v3/users/e3e19dceb1474993ba41e6420045a60d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:03.671248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:03.671762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:03.672047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:03.708194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6f44a3a4-56d7-4160-acbd-9854d36c5cdb None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:03.709627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6f44a3a4-56d7-4160-acbd-9854d36c5cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:03.717110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:03.718615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:03.805263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:03.811705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:03.836818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 902/1816] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:03.845815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:03.847025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:03.847521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:03.880629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 915/1817] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:03.899357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:03.904670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:03.941125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:03.942690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:04.033943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e469727-0519-44a1-8d8a-afb9fb9ef4fe None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:04.040273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:04.042388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.043084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.043746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.059161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:04.062122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:04.079200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 916/1818] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:30:04.080620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:04.082172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:04.094534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 903/1819] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:30:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:04.097959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3dc21-de16-4377-aea1-d331bb7ef944 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:04.103581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:04.104537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.105042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.105609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.124964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:04.126990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:04.145330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 917/1820] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:04.965073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:04.969575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:04.985859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a6d24-fed6-451f-91da-b6817d190826 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:04.993957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772791e-17aa-4010-a9f6-7473c3f4e7cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:04.994885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772791e-17aa-4010-a9f6-7473c3f4e7cc service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.995181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772791e-17aa-4010-a9f6-7473c3f4e7cc service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.995467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772791e-17aa-4010-a9f6-7473c3f4e7cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.006119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772791e-17aa-4010-a9f6-7473c3f4e7cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.008275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772791e-17aa-4010-a9f6-7473c3f4e7cc service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.023215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 904/1821] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:05.085138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.086670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:05.110565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3475f6-dabd-44cc-b71e-33ecc1dd5bd4 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.120226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.121247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.121430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.121923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] PATH_INFO: `/v3/projects/dbbb91d3e6fb4f80bea9906bdb84ef0e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.125575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbbb91d3e6fb4f80bea9906bdb84ef0e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.127664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.238911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbbb91d3e6fb4f80bea9906bdb84ef0e', 'request_id': 'req-f0861352-b84b-4b9b-91e0-627155086a7a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:05.254348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbbb91d3e6fb4f80bea9906bdb84ef0e', 'request_id': 'req-f0861352-b84b-4b9b-91e0-627155086a7a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:05.261465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbbb91d3e6fb4f80bea9906bdb84ef0e', 'request_id': 'req-f0861352-b84b-4b9b-91e0-627155086a7a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:05.292460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] The token cache is being invalidate because project dbbb91d3e6fb4f80bea9906bdb84ef0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:05.292751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:05.293430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f0861352-b84b-4b9b-91e0-627155086a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:05.296252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 918/1822] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:05 2022] DELETE /identity/v3/projects/dbbb91d3e6fb4f80bea9906bdb84ef0e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:05.300931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0074a8-3365-4a40-90d3-35a58fb39b59 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.301782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0074a8-3365-4a40-90d3-35a58fb39b59 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.302202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0074a8-3365-4a40-90d3-35a58fb39b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.343833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7e0074a8-3365-4a40-90d3-35a58fb39b59 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:05.348341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7e0074a8-3365-4a40-90d3-35a58fb39b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:05.443689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 905/1823] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:05.450994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eb970-5e25-485b-9935-a6e825cbaf13 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.451672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eb970-5e25-485b-9935-a6e825cbaf13 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.452116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83eb970-5e25-485b-9935-a6e825cbaf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.473388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c83eb970-5e25-485b-9935-a6e825cbaf13 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:05.474908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c83eb970-5e25-485b-9935-a6e825cbaf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:05.491488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 919/1824] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:05.492697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0074a8-3365-4a40-90d3-35a58fb39b59 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.508491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0074a8-3365-4a40-90d3-35a58fb39b59 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.514992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bb7d4-f5f6-44ce-a9d3-5da55f76ecea None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.515501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bb7d4-f5f6-44ce-a9d3-5da55f76ecea None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.516828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bb7d4-f5f6-44ce-a9d3-5da55f76ecea None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.517108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af9f27-63b5-4450-8af1-c1dbf73fc601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.517847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af9f27-63b5-4450-8af1-c1dbf73fc601 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.518582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af9f27-63b5-4450-8af1-c1dbf73fc601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.519082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 920/1825] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:30:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:30:05.519214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af9f27-63b5-4450-8af1-c1dbf73fc601 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.520470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af9f27-63b5-4450-8af1-c1dbf73fc601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:05.521031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af9f27-63b5-4450-8af1-c1dbf73fc601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.523021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af9f27-63b5-4450-8af1-c1dbf73fc601 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.541033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 906/1826] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:05.545567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bb7d4-f5f6-44ce-a9d3-5da55f76ecea None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.551021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.552605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.552888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.575413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bb7d4-f5f6-44ce-a9d3-5da55f76ecea None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.582740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.584212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.584751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.585159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.586408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.589047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.591459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:05.593528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:05.648431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 921/1827] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:05 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:05.655613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.715920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.734838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.759470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 907/1828] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:05.791951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b43f-ce6c-4f93-8bd7-37851b855170 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.793372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.799030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.800525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.800940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.801368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.802167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.805052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.823666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:05.847238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 922/1829] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:05 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:05.847238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.851001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656acbab-5c81-4065-b2e4-c9c3200534aa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.851363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:05.855974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.856657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.856933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.857202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] PATH_INFO: `/v3/projects/0a21059086694bbbaf3f37c7ce32043d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.858323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a21059086694bbbaf3f37c7ce32043d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.860295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.974155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a21059086694bbbaf3f37c7ce32043d', 'request_id': 'req-3c0b2c30-586d-46a7-8c15-7074de8dad75'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:05.981110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a21059086694bbbaf3f37c7ce32043d', 'request_id': 'req-3c0b2c30-586d-46a7-8c15-7074de8dad75'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:05.987673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a21059086694bbbaf3f37c7ce32043d', 'request_id': 'req-3c0b2c30-586d-46a7-8c15-7074de8dad75'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.008884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] The token cache is being invalidate because project 0a21059086694bbbaf3f37c7ce32043d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:06.009204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.009978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.012607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 908/1830] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:05 2022] DELETE /identity/v3/projects/0a21059086694bbbaf3f37c7ce32043d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:06.013685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.015018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.027953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0db02f-eea1-433a-882f-d60c47c2ed8b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.110333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b2c30-586d-46a7-8c15-7074de8dad75 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.115969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.116643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.117013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.117585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.118324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.122178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.123732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.124113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.124319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.124730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.127062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.138705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 909/1831] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:06.138705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.144736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.146349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.149108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.159987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 923/1832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:06.161362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.162824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c82d2-e20e-4f5c-b5ab-5c42fcd9b6a4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.162939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.167674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.168324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.168744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.169149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] PATH_INFO: `/v3/projects/559e9c8ef563427eb8f7a93a1ff34747` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.170488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=559e9c8ef563427eb8f7a93a1ff34747)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.172756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.179826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f8fe1-8589-4f9e-801a-da8dba8e810f service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.186253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.187042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.187427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.187832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] PATH_INFO: `/v3/users/d961dbe645ea4b2abc1741b8a6fc1af3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.189220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d961dbe645ea4b2abc1741b8a6fc1af3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.191361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.246141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.255272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '559e9c8ef563427eb8f7a93a1ff34747', 'request_id': 'req-e9d7949a-6366-4914-a6c4-b8c1df419a2d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.264228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '559e9c8ef563427eb8f7a93a1ff34747', 'request_id': 'req-e9d7949a-6366-4914-a6c4-b8c1df419a2d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.272308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '559e9c8ef563427eb8f7a93a1ff34747', 'request_id': 'req-e9d7949a-6366-4914-a6c4-b8c1df419a2d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.277352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.278555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd961dbe645ea4b2abc1741b8a6fc1af3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.291292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] The token cache is being invalidate because project 559e9c8ef563427eb8f7a93a1ff34747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:06.291756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.293148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.295527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 910/1833] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:06 2022] DELETE /identity/v3/projects/559e9c8ef563427eb8f7a93a1ff34747 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:06.295876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd961dbe645ea4b2abc1741b8a6fc1af3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.296580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd961dbe645ea4b2abc1741b8a6fc1af3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.297087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.298870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.312021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd961dbe645ea4b2abc1741b8a6fc1af3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.327684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd961dbe645ea4b2abc1741b8a6fc1af3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.334308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 924/1834] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:06 2022] DELETE /identity/v3/users/d961dbe645ea4b2abc1741b8a6fc1af3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:06.336387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.338738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.370098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7949a-6366-4914-a6c4-b8c1df419a2d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.449429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afcebc-e900-48a7-9637-464c8a6c4fd3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.455172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.456646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.456996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.457345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] PATH_INFO: `/v3/users/f5c3c5c13cb640f7bea661098a7c1527` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.458740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c3c5c13cb640f7bea661098a7c1527)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.459652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.461339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.461339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.461569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.461657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.462030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.465715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.479222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 911/1835] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:06.484127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.486110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.520857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8712cb2-bd63-4809-96ec-c4e8bc3e31e2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.527739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16a58-eb8b-4327-9025-b8d8c1a1f69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.528824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16a58-eb8b-4327-9025-b8d8c1a1f69a admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.529123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16a58-eb8b-4327-9025-b8d8c1a1f69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.529387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16a58-eb8b-4327-9025-b8d8c1a1f69a admin admin] PATH_INFO: `/v3/projects/ff2e89d2c1604d4e8af8b0b2fb947dc1/users/f53f85d1b8594277974ab118f0ba7794/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.534001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c3c5c13cb640f7bea661098a7c1527'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.543754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c3c5c13cb640f7bea661098a7c1527'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.544935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c3c5c13cb640f7bea661098a7c1527'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.548286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16a58-eb8b-4327-9025-b8d8c1a1f69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2e89d2c1604d4e8af8b0b2fb947dc1, user_id=f53f85d1b8594277974ab118f0ba7794, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.551287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16a58-eb8b-4327-9025-b8d8c1a1f69a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.553108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c3c5c13cb640f7bea661098a7c1527'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.569952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 912/1836] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:06 2022] PUT /identity/v3/projects/ff2e89d2c1604d4e8af8b0b2fb947dc1/users/f53f85d1b8594277974ab118f0ba7794/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:06.579750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c3c5c13cb640f7bea661098a7c1527'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.579750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 925/1837] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:06 2022] DELETE /identity/v3/users/f5c3c5c13cb640f7bea661098a7c1527 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:06.582383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.583761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.584138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.617766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] MFA Rules not processed for user `f53f85d1b8594277974ab118f0ba7794`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:06.619409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.686562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.688323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.772928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.778474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 913/1838] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:06.780079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.783235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.792666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.836100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673a762-79f6-49c2-ad81-9bf83335b66e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.842393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.842815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.843101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.843432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] PATH_INFO: `/v3/projects/9353567e748c4ba485c8cba229fa3360` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.844819 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9353567e748c4ba485c8cba229fa3360)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.848684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.918225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79141e-6c73-4e62-b68e-529e3b96838c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.944808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9353567e748c4ba485c8cba229fa3360', 'request_id': 'req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.963414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9353567e748c4ba485c8cba229fa3360', 'request_id': 'req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.974284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9353567e748c4ba485c8cba229fa3360', 'request_id': 'req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.991377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] The token cache is being invalidate because project 9353567e748c4ba485c8cba229fa3360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:06.992130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.993026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6cd338ac-11dd-4bfa-9a74-92f9ca066d2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:06.995921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 926/1839] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:06 2022] DELETE /identity/v3/projects/9353567e748c4ba485c8cba229fa3360 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:07.001079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c77b8-9966-4729-9c4c-b24b2324b6ba None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.001416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c77b8-9966-4729-9c4c-b24b2324b6ba None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.001637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c77b8-9966-4729-9c4c-b24b2324b6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.021000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.022128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.022779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.023404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.024700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.027005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.031039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-777c77b8-9966-4729-9c4c-b24b2324b6ba None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:07.032390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-777c77b8-9966-4729-9c4c-b24b2324b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.041491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 927/1840] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:07.049202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878c861-97b1-4d78-aa2b-dd4392b6a540 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.049538 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878c861-97b1-4d78-aa2b-dd4392b6a540 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.049814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878c861-97b1-4d78-aa2b-dd4392b6a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.071832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 914/1841] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:06 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:07.075382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0878c861-97b1-4d78-aa2b-dd4392b6a540 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:07.076593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.076733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0878c861-97b1-4d78-aa2b-dd4392b6a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.079667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.147908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 928/1842] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:07.153926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878c861-97b1-4d78-aa2b-dd4392b6a540 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.165523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878c861-97b1-4d78-aa2b-dd4392b6a540 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.172126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.173265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.173543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.173810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.174606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:07.174744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.176390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.185716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c77bf-95c5-4425-9f19-bb53e539d767 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.192965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 929/1843] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:07.194172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.195939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.196528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.196803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.197479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.198782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.200220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.223964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c7b3a-a6da-41fa-b3f6-f3c30c67d89d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.242356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 915/1844] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:07 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:07.242510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.242510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.242510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.242734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.243387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.243582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.245443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.255956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cda2ef-9ad4-4acd-bbfc-bbc0fdcfe0e4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.261483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.262106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.262466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.262741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.264296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.266101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.283409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 916/1845] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:07.286873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 930/1846] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:07 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:07.286993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.288472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.298239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d683f54-dfc9-4c19-9147-1948d67585af admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.308458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.319869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.359645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaca84-14ac-4340-ad20-af7a31cbad80 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.366991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.367640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.367932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.368194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.368824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.370732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.395601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.395601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.395601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.395601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] PATH_INFO: `/v3/projects/491f33a5d901492bb28dbcfcf77eb63b/users/4fe4827ffc8b4ed1a8d27cfe1fabebda/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.402420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 931/1847] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:07 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:07.405360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.424061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad948ade-0818-4e6b-9c07-82e0a18c91bb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.433644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] RBAC: Authorizing `identity:create_grant(project_id=491f33a5d901492bb28dbcfcf77eb63b, user_id=4fe4827ffc8b4ed1a8d27cfe1fabebda, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.439709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.440012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.441428 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.442249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.445631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.449183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.449986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.476569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 917/1848] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:07 2022] PUT /identity/v3/projects/491f33a5d901492bb28dbcfcf77eb63b/users/4fe4827ffc8b4ed1a8d27cfe1fabebda/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:07.477125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 932/1849] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:07.480650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.487126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.505752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27b326-dc09-41bd-9737-487d71bb1ae8 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.569791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ef6e-0841-4bb0-89ad-5881ac9d441d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.576012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.577272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.577648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.578022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.579013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.581736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.596475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 918/1850] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:07.600297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.612539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77c0e6-0882-4d0e-86b2-94f9421242e3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.620064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa1d92-db2e-48b7-ad47-cdcd040b2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.620867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1d92-db2e-48b7-ad47-cdcd040b2afe admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.621854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1d92-db2e-48b7-ad47-cdcd040b2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.621854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa1d92-db2e-48b7-ad47-cdcd040b2afe admin admin] PATH_INFO: `/v3/projects/491f33a5d901492bb28dbcfcf77eb63b/users/4fe4827ffc8b4ed1a8d27cfe1fabebda/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.623881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1d92-db2e-48b7-ad47-cdcd040b2afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=491f33a5d901492bb28dbcfcf77eb63b, user_id=4fe4827ffc8b4ed1a8d27cfe1fabebda, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.627734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa1d92-db2e-48b7-ad47-cdcd040b2afe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.632260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.633728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.634184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.634637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.635458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.638281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.644290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 919/1851] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:07 2022] PUT /identity/v3/projects/491f33a5d901492bb28dbcfcf77eb63b/users/4fe4827ffc8b4ed1a8d27cfe1fabebda/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:07.651051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 933/1852] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:07.655495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.655495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.655495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.656497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.671053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142ab1b-d5bf-434f-9b28-a293474084b7 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.696253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] MFA Rules not processed for user `4fe4827ffc8b4ed1a8d27cfe1fabebda`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:07.698236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.751150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922038d-79b5-4553-a185-0d8b20e65978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.752324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922038d-79b5-4553-a185-0d8b20e65978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.752867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922038d-79b5-4553-a185-0d8b20e65978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.753454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922038d-79b5-4553-a185-0d8b20e65978 admin admin] PATH_INFO: `/v3/projects/d8034bce2e1749bba4fb4b2cbfc3020a/users/149a10f68b6a40eb9ede5379aa15c3a5/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.776960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922038d-79b5-4553-a185-0d8b20e65978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8034bce2e1749bba4fb4b2cbfc3020a, user_id=149a10f68b6a40eb9ede5379aa15c3a5, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.780942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922038d-79b5-4553-a185-0d8b20e65978 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.797970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 920/1853] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:07.810789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 934/1854] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:07 2022] PUT /identity/v3/projects/d8034bce2e1749bba4fb4b2cbfc3020a/users/149a10f68b6a40eb9ede5379aa15c3a5/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:07.821349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.821909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.822200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.822510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.823833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.838315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.863286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.868023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] MFA Rules not processed for user `149a10f68b6a40eb9ede5379aa15c3a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:07.871464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.906775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a75ff6-aab8-4f0e-803f-69b88b5434c4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.973287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.973956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.974370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.974723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.977337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.986531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 935/1855] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:07.999865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.002031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:08.057243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.058959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.071726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 921/1856] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:08.174201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc19a2c-f341-44ae-8e00-89a545fe8e00 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.186565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde0c2b-cede-4573-a9c0-fdb62f78f4cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78fc219a25457ca11e38930b03e8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.187207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde0c2b-cede-4573-a9c0-fdb62f78f4cc service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.187490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde0c2b-cede-4573-a9c0-fdb62f78f4cc service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.188132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde0c2b-cede-4573-a9c0-fdb62f78f4cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.201130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde0c2b-cede-4573-a9c0-fdb62f78f4cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.203371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde0c2b-cede-4573-a9c0-fdb62f78f4cc service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.219330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 936/1857] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:30:08.412617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.414508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:08.579672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b787b2-6bbf-4165-8baf-6a85bae5434c service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.587197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.588029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.588573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.589071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] PATH_INFO: `/v3/projects/064e490c375e41f18dc5d45b754ffbd6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.590762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064e490c375e41f18dc5d45b754ffbd6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.593309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.644634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:08.714737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064e490c375e41f18dc5d45b754ffbd6', 'request_id': 'req-f72b2b10-becc-420c-aae9-8c148034b768'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:08.720911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064e490c375e41f18dc5d45b754ffbd6', 'request_id': 'req-f72b2b10-becc-420c-aae9-8c148034b768'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:08.728032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064e490c375e41f18dc5d45b754ffbd6', 'request_id': 'req-f72b2b10-becc-420c-aae9-8c148034b768'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:08.746422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] The token cache is being invalidate because project 064e490c375e41f18dc5d45b754ffbd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:08.746789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:08.747528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f72b2b10-becc-420c-aae9-8c148034b768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:08.749355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 922/1858] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:08 2022] DELETE /identity/v3/projects/064e490c375e41f18dc5d45b754ffbd6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:08.755500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab0a5e-d2c3-4fbd-ac99-3e52e0872a01 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.755828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab0a5e-d2c3-4fbd-ac99-3e52e0872a01 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.756109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab0a5e-d2c3-4fbd-ac99-3e52e0872a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.795573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8aab0a5e-d2c3-4fbd-ac99-3e52e0872a01 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:08.797936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8aab0a5e-d2c3-4fbd-ac99-3e52e0872a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:08.879153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 937/1859] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:08.887014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba1f87-7ee1-4a64-b6fb-9cbb91e17b2b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.887406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba1f87-7ee1-4a64-b6fb-9cbb91e17b2b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.887923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba1f87-7ee1-4a64-b6fb-9cbb91e17b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.911942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-19ba1f87-7ee1-4a64-b6fb-9cbb91e17b2b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:08.913275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-19ba1f87-7ee1-4a64-b6fb-9cbb91e17b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:08.930742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 923/1860] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:08.931127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab0a5e-d2c3-4fbd-ac99-3e52e0872a01 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.941929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab0a5e-d2c3-4fbd-ac99-3e52e0872a01 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.954277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.955118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.955402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.955720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.956395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:08.956728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.958456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.982952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 938/1861] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:08.986671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba1f87-7ee1-4a64-b6fb-9cbb91e17b2b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.998831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba1f87-7ee1-4a64-b6fb-9cbb91e17b2b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.005605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.006232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.006560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.006836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.007582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.009717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.047588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 924/1862] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:08 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:09.052151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.063514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201da29-4c75-4c64-8e55-831965a5bdf3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.074724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.127254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.127920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.128202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.128477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.129117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.131103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.153939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 939/1863] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:09 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:09.158199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.169001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99868911-d4f1-41c8-9656-e4c28bae7efd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.174276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.174882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.175167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.175430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.176110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.177736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.189138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 925/1864] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:09.193513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.206342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651dbb8-26e9-45ad-985f-54e0bc320fe3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.212257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85608d-b117-42cf-8889-7b92e6528a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.212879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85608d-b117-42cf-8889-7b92e6528a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.213154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85608d-b117-42cf-8889-7b92e6528a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.213423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85608d-b117-42cf-8889-7b92e6528a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.214073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85608d-b117-42cf-8889-7b92e6528a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.215866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85608d-b117-42cf-8889-7b92e6528a41 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.229707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 940/1865] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:09.234458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.245741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79db4fd-25db-4dd7-9ef0-15663c364b12 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.251665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.252281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.252558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.253161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] PATH_INFO: `/v3/projects/8c3c3e2459144b489083639fdfca5256/users/f31ce16301ee495da4d5eef1b7089b47/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.269937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3c3e2459144b489083639fdfca5256, user_id=f31ce16301ee495da4d5eef1b7089b47, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.272665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.291582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 926/1866] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:09 2022] PUT /identity/v3/projects/8c3c3e2459144b489083639fdfca5256/users/f31ce16301ee495da4d5eef1b7089b47/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:09.302848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686dae-6bdf-41ca-a496-056ceed63085 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.303138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686dae-6bdf-41ca-a496-056ceed63085 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.303412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74686dae-6bdf-41ca-a496-056ceed63085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.334373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-74686dae-6bdf-41ca-a496-056ceed63085 None None] MFA Rules not processed for user `f31ce16301ee495da4d5eef1b7089b47`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:09.335832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-74686dae-6bdf-41ca-a496-056ceed63085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:09.406968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 941/1867] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:09.411589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.492449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b677cda-c0d9-4406-ab97-17cb12e5267d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.498087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.499390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.501986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.502098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.502767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.504709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.534895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 927/1868] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:09 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:09.538835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74686dae-6bdf-41ca-a496-056ceed63085 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.550551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74686dae-6bdf-41ca-a496-056ceed63085 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.664210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.664881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.665190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.665457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.666114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.668109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.700780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 942/1869] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:09 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:09.702583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.713450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b65e-d7f3-495a-ada6-f6e5231478f6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.722368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.723124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.723405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.723710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.724430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.726189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.742989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 928/1870] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:09.747602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.762319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2b63e-0917-4dbc-958c-fe1cf5e3f364 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.767278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.768031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.768315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.768718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] PATH_INFO: `/v3/projects/8d9b34a9c73b4269b14575b046769e3f/users/05fb03e6a8bb48989747b952dc396a4e/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.785721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.805670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9b34a9c73b4269b14575b046769e3f, user_id=05fb03e6a8bb48989747b952dc396a4e, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.808433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.834479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 943/1871] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:09 2022] PUT /identity/v3/projects/8d9b34a9c73b4269b14575b046769e3f/users/05fb03e6a8bb48989747b952dc396a4e/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:09.835506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.859131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b63c5-eb81-4384-bb78-23a2391431d9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.882015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.940256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5fa6a-be85-4a0c-b482-47efb6690006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.941244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5fa6a-be85-4a0c-b482-47efb6690006 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.941697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5fa6a-be85-4a0c-b482-47efb6690006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.942154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5fa6a-be85-4a0c-b482-47efb6690006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.942876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5fa6a-be85-4a0c-b482-47efb6690006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.944586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5fa6a-be85-4a0c-b482-47efb6690006 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.955471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 929/1872] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:09.959614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.986722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330876-f669-46c3-9f9e-7b89ccd05989 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.993411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.994852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.995303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.995829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] PATH_INFO: `/v3/projects/8d9b34a9c73b4269b14575b046769e3f/users/05fb03e6a8bb48989747b952dc396a4e/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.998998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9b34a9c73b4269b14575b046769e3f, user_id=05fb03e6a8bb48989747b952dc396a4e, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:10.005204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:10.035656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 944/1873] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:09 2022] PUT /identity/v3/projects/8d9b34a9c73b4269b14575b046769e3f/users/05fb03e6a8bb48989747b952dc396a4e/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:10.048011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5574-7c84-4695-bf1a-a676810b761a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.048298 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5574-7c84-4695-bf1a-a676810b761a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.048611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5574-7c84-4695-bf1a-a676810b761a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.079538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-73ec5574-7c84-4695-bf1a-a676810b761a None None] MFA Rules not processed for user `05fb03e6a8bb48989747b952dc396a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:10.080794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-73ec5574-7c84-4695-bf1a-a676810b761a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:10.160953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 930/1874] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:10.172726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:10.174575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:10.236538 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79dffb-a926-4597-a1d7-dc0ce37fcb8e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:10.240548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:10.241158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.241434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.241704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.251682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:10.253109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:10.263846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 945/1875] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:10.884534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5574-7c84-4695-bf1a-a676810b761a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:10.952969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5574-7c84-4695-bf1a-a676810b761a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:10.957737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:10.958476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.958821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.959161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] PATH_INFO: `/v3/users/f31ce16301ee495da4d5eef1b7089b47` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.960412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31ce16301ee495da4d5eef1b7089b47)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:10.962407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.016431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:11.024857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31ce16301ee495da4d5eef1b7089b47'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.034322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31ce16301ee495da4d5eef1b7089b47'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.056128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31ce16301ee495da4d5eef1b7089b47'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.056658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.057061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31ce16301ee495da4d5eef1b7089b47'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.058667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:11.065444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c591760c-b4ec-4df7-b4e3-87f3625ba4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31ce16301ee495da4d5eef1b7089b47'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.072102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf3ee0-0346-43bf-ba80-d7c6b42a21ef service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.077697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 931/1876] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:10 2022] DELETE /identity/v3/users/f31ce16301ee495da4d5eef1b7089b47 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:11.079747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.079880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.079989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.079989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.080148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.080148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.080425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.082149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:11.099914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:11.101108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:11.171804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.171804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.184576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 932/1877] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:11.196236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 946/1878] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:11.202919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.205281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:11.271753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8763a-57aa-4521-add9-1cf41cfd1c85 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.276257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.276257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.276551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.276824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.316974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.318519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.347773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 933/1879] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:11.776649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.779097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:11.820489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f012f0-311a-4b00-ab7c-e7e3c9720bbe service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.829131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.829870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.830238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.830518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] PATH_INFO: `/v3/projects/8c3c3e2459144b489083639fdfca5256` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.831710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3c3e2459144b489083639fdfca5256)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.833747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.890540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3c3e2459144b489083639fdfca5256', 'request_id': 'req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.899597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3c3e2459144b489083639fdfca5256', 'request_id': 'req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.906756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3c3e2459144b489083639fdfca5256', 'request_id': 'req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.913325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:11.921957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] The token cache is being invalidate because project 8c3c3e2459144b489083639fdfca5256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:11.922404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.923695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:11.925421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 947/1880] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:11 2022] DELETE /identity/v3/projects/8c3c3e2459144b489083639fdfca5256 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:11.929761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.954137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543c974-8a8d-4636-8080-4b21f2aab0a3 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:12.034297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:12.036203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.036487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.036781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] PATH_INFO: `/v3/users/05fb03e6a8bb48989747b952dc396a4e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.038319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fb03e6a8bb48989747b952dc396a4e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:12.041368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:12.046561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:12.105602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fb03e6a8bb48989747b952dc396a4e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.119348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fb03e6a8bb48989747b952dc396a4e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.135343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fb03e6a8bb48989747b952dc396a4e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.136326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fb03e6a8bb48989747b952dc396a4e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.146687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-edeb3530-725a-4580-b683-42f0fe403ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fb03e6a8bb48989747b952dc396a4e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.153267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 934/1881] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:11 2022] DELETE /identity/v3/users/05fb03e6a8bb48989747b952dc396a4e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:12.519662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:12.521775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:12.542295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39f444-0515-4c6f-b81e-6cc2aaeb7d42 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:12.638703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:12.639378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.639676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.640325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] PATH_INFO: `/v3/projects/8d9b34a9c73b4269b14575b046769e3f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.641272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9b34a9c73b4269b14575b046769e3f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:12.643300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:12.694240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9b34a9c73b4269b14575b046769e3f', 'request_id': 'req-20fcf931-0868-4d52-933b-031ecef826a8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.705216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9b34a9c73b4269b14575b046769e3f', 'request_id': 'req-20fcf931-0868-4d52-933b-031ecef826a8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.714480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9b34a9c73b4269b14575b046769e3f', 'request_id': 'req-20fcf931-0868-4d52-933b-031ecef826a8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.734465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] The token cache is being invalidate because project 8d9b34a9c73b4269b14575b046769e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:12.735004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.735781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-20fcf931-0868-4d52-933b-031ecef826a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:12.738822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 948/1882] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:12 2022] DELETE /identity/v3/projects/8d9b34a9c73b4269b14575b046769e3f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:12.743962 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac17c-e479-405b-905d-82a579b9ce4a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.744382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac17c-e479-405b-905d-82a579b9ce4a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.744576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dac17c-e479-405b-905d-82a579b9ce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.768518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a2dac17c-e479-405b-905d-82a579b9ce4a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:12.769804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a2dac17c-e479-405b-905d-82a579b9ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:12.842011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 935/1883] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:12.850145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270679e-3ab7-4222-9124-f8e4c193bcdb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.850696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270679e-3ab7-4222-9124-f8e4c193bcdb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.850696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270679e-3ab7-4222-9124-f8e4c193bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.873369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7270679e-3ab7-4222-9124-f8e4c193bcdb None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:12.874581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7270679e-3ab7-4222-9124-f8e4c193bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:12.882528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 949/1884] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:12.886853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac17c-e479-405b-905d-82a579b9ce4a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:12.896499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dac17c-e479-405b-905d-82a579b9ce4a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:12.901066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:12.901673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.901952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.902227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.903021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:12.903404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:12.904977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:12.917989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 936/1885] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:12.922445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270679e-3ab7-4222-9124-f8e4c193bcdb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:12.932625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270679e-3ab7-4222-9124-f8e4c193bcdb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:12.937948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:12.938578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.938857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.939117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.939791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:12.941725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:12.969047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 950/1886] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:12 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:12.973404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:12.984517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc290b-92f4-4a82-84cb-4741990382b0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.048209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.048864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.049204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.049493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.050136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.055608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.072849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.083782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 937/1887] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:12 2022] POST /identity/v3/users => generated 281 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:13.084195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.094667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af7488-8bcc-41f3-9847-6204631b744a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.101057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.101976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.102462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.102928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.104016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.106143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.117731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 951/1888] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:13.122323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.132722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9ed41-c99b-4560-9080-80f97c35bde7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.138255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0e9be-c73f-4d2e-aa76-4871b8e7a910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.138878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e9be-c73f-4d2e-aa76-4871b8e7a910 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.139162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e9be-c73f-4d2e-aa76-4871b8e7a910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.139512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0e9be-c73f-4d2e-aa76-4871b8e7a910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.140120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0e9be-c73f-4d2e-aa76-4871b8e7a910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.141719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0e9be-c73f-4d2e-aa76-4871b8e7a910 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.153264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 938/1889] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:13.159844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.172646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497b41f-94fd-4be4-9861-2eb8c304e031 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.178820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.179892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.180198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.180497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] PATH_INFO: `/v3/projects/c5d2e56a72b846099aa4f4544046fdad/users/c60df7665e774984a7fa30b6323de69c/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.203269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d2e56a72b846099aa4f4544046fdad, user_id=c60df7665e774984a7fa30b6323de69c, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.206040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.225156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 952/1890] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:13 2022] PUT /identity/v3/projects/c5d2e56a72b846099aa4f4544046fdad/users/c60df7665e774984a7fa30b6323de69c/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:13.237383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083867e8-a3e0-48d1-b19e-c6fe0ad840b5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.237671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083867e8-a3e0-48d1-b19e-c6fe0ad840b5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.237947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083867e8-a3e0-48d1-b19e-c6fe0ad840b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.272370 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-083867e8-a3e0-48d1-b19e-c6fe0ad840b5 None None] MFA Rules not processed for user `c60df7665e774984a7fa30b6323de69c`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:13.273589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-083867e8-a3e0-48d1-b19e-c6fe0ad840b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:13.353773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 939/1891] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:13.389277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.391276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:13.414734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.466901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e953-b993-49fd-871e-d107a877efda admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.470788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ae4d0-64b6-4354-950d-37406d34dce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.471500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae4d0-64b6-4354-950d-37406d34dce1 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.472441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae4d0-64b6-4354-950d-37406d34dce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.472713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae4d0-64b6-4354-950d-37406d34dce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.482153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ae4d0-64b6-4354-950d-37406d34dce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.483602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ae4d0-64b6-4354-950d-37406d34dce1 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.492700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 953/1892] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:13.508636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083867e8-a3e0-48d1-b19e-c6fe0ad840b5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.574017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083867e8-a3e0-48d1-b19e-c6fe0ad840b5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.580140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.580817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.581093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.583067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] PATH_INFO: `/v3/users/c60df7665e774984a7fa30b6323de69c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.584510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60df7665e774984a7fa30b6323de69c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.586466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.656885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60df7665e774984a7fa30b6323de69c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:13.668727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60df7665e774984a7fa30b6323de69c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:13.685308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60df7665e774984a7fa30b6323de69c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:13.686284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60df7665e774984a7fa30b6323de69c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:13.692462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.694840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60df7665e774984a7fa30b6323de69c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:13.703869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 940/1893] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:13 2022] DELETE /identity/v3/users/c60df7665e774984a7fa30b6323de69c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:13.708585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.708874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.709346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.729280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:13.730519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:13.797598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 954/1894] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:13.807662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.811772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:13.881035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d979d75-92c8-44cb-8ca3-08f7d541b57a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.884874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880afb42-4ed8-4d6b-853e-009bce935f35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.885510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880afb42-4ed8-4d6b-853e-009bce935f35 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.885790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880afb42-4ed8-4d6b-853e-009bce935f35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.886057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880afb42-4ed8-4d6b-853e-009bce935f35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.898363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880afb42-4ed8-4d6b-853e-009bce935f35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.900604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880afb42-4ed8-4d6b-853e-009bce935f35 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.928769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 941/1895] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:14.478506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.481828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:14.499700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219fa1-b3d0-44eb-a8e3-db083fe468ea None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.506242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.507046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.507422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.507789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] PATH_INFO: `/v3/projects/c5d2e56a72b846099aa4f4544046fdad` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.509151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d2e56a72b846099aa4f4544046fdad)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.511177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.565686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d2e56a72b846099aa4f4544046fdad', 'request_id': 'req-ce666131-45d6-4e02-b3c1-de19ba34c232'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:14.575400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d2e56a72b846099aa4f4544046fdad', 'request_id': 'req-ce666131-45d6-4e02-b3c1-de19ba34c232'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:14.582859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d2e56a72b846099aa4f4544046fdad', 'request_id': 'req-ce666131-45d6-4e02-b3c1-de19ba34c232'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:14.594728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] The token cache is being invalidate because project c5d2e56a72b846099aa4f4544046fdad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:14.595022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:14.595909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ce666131-45d6-4e02-b3c1-de19ba34c232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:14.597498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 955/1896] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:14 2022] DELETE /identity/v3/projects/c5d2e56a72b846099aa4f4544046fdad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:14.602714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ea5d-c725-4582-b246-aa0151defd13 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.603198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ea5d-c725-4582-b246-aa0151defd13 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.603286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ea5d-c725-4582-b246-aa0151defd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.628720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4de1ea5d-c725-4582-b246-aa0151defd13 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:14.630184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4de1ea5d-c725-4582-b246-aa0151defd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:14.693397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 942/1897] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:14.701611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e1d8-897f-4b4f-b576-db0b79aeb3db None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.701924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e1d8-897f-4b4f-b576-db0b79aeb3db None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.702197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439e1d8-897f-4b4f-b576-db0b79aeb3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.722036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7439e1d8-897f-4b4f-b576-db0b79aeb3db None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:14.723279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7439e1d8-897f-4b4f-b576-db0b79aeb3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:14.732341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 956/1898] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:14.736821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1ea5d-c725-4582-b246-aa0151defd13 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.746761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1ea5d-c725-4582-b246-aa0151defd13 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.751759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.752364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.752644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.752919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.753570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:14.753884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.755576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.767575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 943/1899] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:14.771917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e1d8-897f-4b4f-b576-db0b79aeb3db None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.781755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439e1d8-897f-4b4f-b576-db0b79aeb3db None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.786685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.787316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.787702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.787975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.788639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.790631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.821333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 957/1900] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:14 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:14.826215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.836519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e2123-7828-46a0-81ae-17237ac74519 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.924991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.925609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.925882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.926149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.926810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.928925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.957534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 944/1901] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:14 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:14.963679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.975185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487e869-1ec5-40df-8326-f5e7a49ad5ae admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.980103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.980766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.981047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.981325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.981984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.984704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.995312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 958/1902] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:14.999341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:15.013318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457ad52-7710-4d95-8dc8-28233388e927 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:15.018526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdcac9-5caa-4984-ad8b-3ae021814b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:15.019090 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcac9-5caa-4984-ad8b-3ae021814b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.019481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcac9-5caa-4984-ad8b-3ae021814b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.019848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcac9-5caa-4984-ad8b-3ae021814b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.020633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcac9-5caa-4984-ad8b-3ae021814b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:15.022388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcac9-5caa-4984-ad8b-3ae021814b0c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:15.040734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:15.041270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 945/1903] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:15.051880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367d4a1-0cdf-4c5d-bfff-fc401556c872 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:15.057719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:15.058524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.058934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.059317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] PATH_INFO: `/v3/projects/e0fb89d7e4f04af88c80c308d0351168/users/174fd621eac446e5b8f7b6445b5558a4/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.069454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:15.081150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fb89d7e4f04af88c80c308d0351168, user_id=174fd621eac446e5b8f7b6445b5558a4, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:15.086334 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:15.115833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 959/1904] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:15 2022] PUT /identity/v3/projects/e0fb89d7e4f04af88c80c308d0351168/users/174fd621eac446e5b8f7b6445b5558a4/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:15.120033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43446f-1ed6-496e-a9fd-8cc2c98ecda6 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.120451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43446f-1ed6-496e-a9fd-8cc2c98ecda6 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.120891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43446f-1ed6-496e-a9fd-8cc2c98ecda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.134053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:15.158250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3c43446f-1ed6-496e-a9fd-8cc2c98ecda6 None None] MFA Rules not processed for user `174fd621eac446e5b8f7b6445b5558a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:15.159453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3c43446f-1ed6-496e-a9fd-8cc2c98ecda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:15.243102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 946/1905] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:15.256917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:15.259115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:15.328066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde7ff8-64f9-4b8b-8de1-b9ca0c625484 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.328473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde7ff8-64f9-4b8b-8de1-b9ca0c625484 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.328607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde7ff8-64f9-4b8b-8de1-b9ca0c625484 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.332432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 947/1906] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:30:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:15.339575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a23e7-f8e7-4706-80a1-eb0ec0d6a2b6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:15.341401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.341680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.341956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.348259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78fc219a25457ca11e38930b03e8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:15.348928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.349212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.349487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.361697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:15.363198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:15.363472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:15.364767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:15.387630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 960/1907] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:15.447951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 948/1908] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:30:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:15.466251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:15.468362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:15.501862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde52e1-eeb7-432d-a0c2-dbc15734e026 service glance] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:15.511062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ec11e-047b-4544-afd7-dc04e708c394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:15.511716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ec11e-047b-4544-afd7-dc04e708c394 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.512131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ec11e-047b-4544-afd7-dc04e708c394 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.512408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ec11e-047b-4544-afd7-dc04e708c394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.525667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ec11e-047b-4544-afd7-dc04e708c394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:15.527370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ec11e-047b-4544-afd7-dc04e708c394 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:15.541380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 961/1909] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:25.360419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.361877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:25.428875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab055bb-d021-43b4-8e97-bf093984ee13 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.434057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.434701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.435031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.435246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] PATH_INFO: `/v3/users/f53f85d1b8594277974ab118f0ba7794` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.436665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53f85d1b8594277974ab118f0ba7794)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.438916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.473529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:25.494391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53f85d1b8594277974ab118f0ba7794'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:25.502477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53f85d1b8594277974ab118f0ba7794'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:25.522400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53f85d1b8594277974ab118f0ba7794'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:25.523168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53f85d1b8594277974ab118f0ba7794'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:25.530585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53f85d1b8594277974ab118f0ba7794'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:25.535439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:25.540387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 949/1910] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:25 2022] DELETE /identity/v3/users/f53f85d1b8594277974ab118f0ba7794 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:25.544097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.544687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.546816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.575234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:25.576842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:25.653710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 962/1911] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:25.662883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.664460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:25.740957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237061-82da-4ca1-b42f-6d288c2383e2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.744966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.745846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.746200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.746547 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.761522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.763455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.780136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 950/1912] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:30:26.099680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:26.101164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:26.113519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87841c-7346-486e-b56f-e9cdb0e03aab None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:26.119015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:26.119015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:26.119247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:26.119473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] PATH_INFO: `/v3/projects/ff2e89d2c1604d4e8af8b0b2fb947dc1` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:26.120782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2e89d2c1604d4e8af8b0b2fb947dc1)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:26.122782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:26.173968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2e89d2c1604d4e8af8b0b2fb947dc1', 'request_id': 'req-5a70f0d0-5227-425d-bab7-7ad649109242'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.184610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2e89d2c1604d4e8af8b0b2fb947dc1', 'request_id': 'req-5a70f0d0-5227-425d-bab7-7ad649109242'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.192353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2e89d2c1604d4e8af8b0b2fb947dc1', 'request_id': 'req-5a70f0d0-5227-425d-bab7-7ad649109242'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.204469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] The token cache is being invalidate because project ff2e89d2c1604d4e8af8b0b2fb947dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:26.204755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.205429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.206927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 963/1913] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:26 2022] DELETE /identity/v3/projects/ff2e89d2c1604d4e8af8b0b2fb947dc1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:26.210991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:26.221132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131052b-f6e4-455c-a173-328635f15c3c service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:26.278408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:26.279048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:26.279325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:26.279632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] PATH_INFO: `/v3/users/4fe4827ffc8b4ed1a8d27cfe1fabebda` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:26.280868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe4827ffc8b4ed1a8d27cfe1fabebda)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:26.283378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:26.337070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe4827ffc8b4ed1a8d27cfe1fabebda'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.339712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:26.346913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe4827ffc8b4ed1a8d27cfe1fabebda'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.363180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe4827ffc8b4ed1a8d27cfe1fabebda'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.364125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe4827ffc8b4ed1a8d27cfe1fabebda'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.376786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74d43af5-2198-4e56-9298-bdd8de772091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe4827ffc8b4ed1a8d27cfe1fabebda'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:26.383302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 951/1914] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:26 2022] DELETE /identity/v3/users/4fe4827ffc8b4ed1a8d27cfe1fabebda => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:26.991246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:26.994484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:27.024768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70f0d0-5227-425d-bab7-7ad649109242 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:27.113382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:27.114886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.114886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.115062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] PATH_INFO: `/v3/projects/491f33a5d901492bb28dbcfcf77eb63b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.116646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491f33a5d901492bb28dbcfcf77eb63b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:27.119526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:27.175562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:27.210775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491f33a5d901492bb28dbcfcf77eb63b', 'request_id': 'req-320a9772-2a1f-46e0-b5f3-ac7854048c06'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:27.245571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491f33a5d901492bb28dbcfcf77eb63b', 'request_id': 'req-320a9772-2a1f-46e0-b5f3-ac7854048c06'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:27.253190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491f33a5d901492bb28dbcfcf77eb63b', 'request_id': 'req-320a9772-2a1f-46e0-b5f3-ac7854048c06'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:27.265421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] The token cache is being invalidate because project 491f33a5d901492bb28dbcfcf77eb63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:27.265784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:27.266616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-320a9772-2a1f-46e0-b5f3-ac7854048c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:27.272206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 964/1915] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:26 2022] DELETE /identity/v3/projects/491f33a5d901492bb28dbcfcf77eb63b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:27.273917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a725-f9cd-41d5-a90f-59b13a3cca86 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.274209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a725-f9cd-41d5-a90f-59b13a3cca86 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.274491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032a725-f9cd-41d5-a90f-59b13a3cca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.319579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6032a725-f9cd-41d5-a90f-59b13a3cca86 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:27.319579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6032a725-f9cd-41d5-a90f-59b13a3cca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:27.382845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 952/1916] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:27.391944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a49aae-a644-42c8-b415-3b6482e15ca8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.392392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a49aae-a644-42c8-b415-3b6482e15ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.392678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a49aae-a644-42c8-b415-3b6482e15ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.414861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e8a49aae-a644-42c8-b415-3b6482e15ca8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:27.416067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e8a49aae-a644-42c8-b415-3b6482e15ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:27.425925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 965/1917] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:27.432118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a725-f9cd-41d5-a90f-59b13a3cca86 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:27.442616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032a725-f9cd-41d5-a90f-59b13a3cca86 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:27.450387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:27.451234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.451571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.451907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.452834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:27.453148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:27.455321 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:27.467936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 953/1918] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:27.472545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a49aae-a644-42c8-b415-3b6482e15ca8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:27.482144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a49aae-a644-42c8-b415-3b6482e15ca8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:27.488135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:27.488904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.489197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.489454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.490188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:27.492341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:27.523977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 966/1919] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:27 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:27.528594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:27.539464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11111396-0bce-48a9-a788-4fc4ad4ea376 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:27.599618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:27.600291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.600569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.600841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.601499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:27.603431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:27.632828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 954/1920] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:27 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:27.633075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:27.644355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fd14-4b58-4d85-9c7d-6804ef9f8331 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:27.650500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:27.651112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.651392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.651853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.652500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:27.654093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:27.664986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 967/1921] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:27.668861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:27.682889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156610c-532e-45b4-84d3-0d89e89f2ae7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:27.687789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89089688-4323-417e-87a3-a56c5fef9145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:27.688506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089688-4323-417e-87a3-a56c5fef9145 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.688792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089688-4323-417e-87a3-a56c5fef9145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.689159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89089688-4323-417e-87a3-a56c5fef9145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.691458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89089688-4323-417e-87a3-a56c5fef9145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:27.693073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89089688-4323-417e-87a3-a56c5fef9145 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:27.719630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:27.719916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 955/1922] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:27.741190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a006b0-8f7e-4063-b964-9f0215a62012 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:27.746933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:27.749361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.749841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.750343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] PATH_INFO: `/v3/projects/c8973e18542f479faa7d9532af2d24e9/users/52676dfcc6ae4c1e9cd7c4ff780c6401/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.768909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8973e18542f479faa7d9532af2d24e9, user_id=52676dfcc6ae4c1e9cd7c4ff780c6401, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:27.771991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:27.789661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 968/1923] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:27 2022] PUT /identity/v3/projects/c8973e18542f479faa7d9532af2d24e9/users/52676dfcc6ae4c1e9cd7c4ff780c6401/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:27.801339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc8ab-1052-4b1b-bc11-c0d6f96427be None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.801989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc8ab-1052-4b1b-bc11-c0d6f96427be None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.802364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bc8ab-1052-4b1b-bc11-c0d6f96427be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.847469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b25bc8ab-1052-4b1b-bc11-c0d6f96427be None None] MFA Rules not processed for user `52676dfcc6ae4c1e9cd7c4ff780c6401`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:27.854249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b25bc8ab-1052-4b1b-bc11-c0d6f96427be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:27.880109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:27.939720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 956/1924] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:27.944058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.054406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2521-a896-4283-bcd2-aa974ba286d5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.060889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.061724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.062007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.062439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.063660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.065596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.110933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 969/1925] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:27 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:28.115270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bc8ab-1052-4b1b-bc11-c0d6f96427be None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.129409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bc8ab-1052-4b1b-bc11-c0d6f96427be None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.212741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.213522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.213802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.214189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.214874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.216880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.242994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 957/1926] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:28 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:28.244666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.256433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d1b1-5a9c-4d77-a984-10dc9446f033 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.268167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.269142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.269626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.270072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.270911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.272556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.284971 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 970/1927] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:28.289297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.302089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde77bd-97af-4780-b539-5c4706867259 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.308207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.308416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.308706 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.309130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] PATH_INFO: `/v3/projects/094d36297cc54a3ab080b28e08760574/users/0e6cf50ad36c4edd834e04087c962811/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.360079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094d36297cc54a3ab080b28e08760574, user_id=0e6cf50ad36c4edd834e04087c962811, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.363159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.393689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 958/1928] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:28 2022] PUT /identity/v3/projects/094d36297cc54a3ab080b28e08760574/users/0e6cf50ad36c4edd834e04087c962811/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:28.398279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.410554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43082861-d533-4b6d-8103-83a98dcf2a6a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.436014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:28.484107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466896c5-b315-47e2-8514-67390ebf986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.484764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466896c5-b315-47e2-8514-67390ebf986e admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.485504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466896c5-b315-47e2-8514-67390ebf986e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.485504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466896c5-b315-47e2-8514-67390ebf986e admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.486412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466896c5-b315-47e2-8514-67390ebf986e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.488231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466896c5-b315-47e2-8514-67390ebf986e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.499873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 971/1929] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:28.504887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.515754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005149c-8511-4a2c-8c5f-7aa6f7bf1631 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.520403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.521170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.521483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.521607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] PATH_INFO: `/v3/projects/094d36297cc54a3ab080b28e08760574/users/0e6cf50ad36c4edd834e04087c962811/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.523537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094d36297cc54a3ab080b28e08760574, user_id=0e6cf50ad36c4edd834e04087c962811, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.526234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.538754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 959/1930] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:28 2022] PUT /identity/v3/projects/094d36297cc54a3ab080b28e08760574/users/0e6cf50ad36c4edd834e04087c962811/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:28.549449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.549737 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.550018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.582078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] MFA Rules not processed for user `0e6cf50ad36c4edd834e04087c962811`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:28.583319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:28.657387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 972/1931] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:28.671389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.673663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:28.740533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b671e-72fd-460a-8c7d-2fc8b77fe245 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.744859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.748280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.748702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.748981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.759662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.761155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.773167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 960/1932] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:28.825558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.827050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:28.840984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc0f36-929e-44b0-8b98-e3a87770e1a1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.844952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3e74a-5335-43de-947e-46f9d2ad0043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.845554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e74a-5335-43de-947e-46f9d2ad0043 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.845831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e74a-5335-43de-947e-46f9d2ad0043 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.846101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e74a-5335-43de-947e-46f9d2ad0043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.912476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3e74a-5335-43de-947e-46f9d2ad0043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:28.915014 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3e74a-5335-43de-947e-46f9d2ad0043 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:28.925268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 973/1933] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:32.636283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.663318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.740012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37131375-e93a-4e30-b298-33b57c639b1a service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.747678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.754458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.754751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.755042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] PATH_INFO: `/v3/users/52676dfcc6ae4c1e9cd7c4ff780c6401` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.757784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52676dfcc6ae4c1e9cd7c4ff780c6401)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.760926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.824445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52676dfcc6ae4c1e9cd7c4ff780c6401'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:32.835025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52676dfcc6ae4c1e9cd7c4ff780c6401'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:32.853805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52676dfcc6ae4c1e9cd7c4ff780c6401'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:32.854568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52676dfcc6ae4c1e9cd7c4ff780c6401'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:32.869112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52676dfcc6ae4c1e9cd7c4ff780c6401'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:32.897826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 961/1934] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:32 2022] DELETE /identity/v3/users/52676dfcc6ae4c1e9cd7c4ff780c6401 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:32.902406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.902934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.902934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.932365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:32.933938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:33.015332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.069333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 974/1935] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:33.076412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.077897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:33.176878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37832a4-db59-42d5-94b7-b5c28164f967 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.181192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.181951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.182320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.182709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.195925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.197602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.208449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 962/1936] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:33.493465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.494943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:33.510593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d5fbd-047c-4b98-89a3-a72612c211d6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.518420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.519850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.521568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.522113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] PATH_INFO: `/v3/projects/c8973e18542f479faa7d9532af2d24e9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.524421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8973e18542f479faa7d9532af2d24e9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.526701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.614468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8973e18542f479faa7d9532af2d24e9', 'request_id': 'req-c45e7ef8-816f-406f-b63d-4894d85f0ffe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.627759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8973e18542f479faa7d9532af2d24e9', 'request_id': 'req-c45e7ef8-816f-406f-b63d-4894d85f0ffe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.634630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8973e18542f479faa7d9532af2d24e9', 'request_id': 'req-c45e7ef8-816f-406f-b63d-4894d85f0ffe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.647033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] The token cache is being invalidate because project c8973e18542f479faa7d9532af2d24e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:33.647372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.648386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.650386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 975/1937] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:33 2022] DELETE /identity/v3/projects/c8973e18542f479faa7d9532af2d24e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:33.654160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.665593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f897f2-d2fa-4c11-af00-1f951abe1c0d service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.726065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.752121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.752964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.753238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.753497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] PATH_INFO: `/v3/users/0e6cf50ad36c4edd834e04087c962811` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.756304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6cf50ad36c4edd834e04087c962811)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.758237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.826617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6cf50ad36c4edd834e04087c962811'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.841678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6cf50ad36c4edd834e04087c962811'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.869514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6cf50ad36c4edd834e04087c962811'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.870622 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6cf50ad36c4edd834e04087c962811'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.878546 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-92c271da-efda-4ec2-9d19-adc415ba3ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6cf50ad36c4edd834e04087c962811'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:33.889355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 963/1938] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:33 2022] DELETE /identity/v3/users/0e6cf50ad36c4edd834e04087c962811 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:34.270258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.272601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:34.304262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e7ef8-816f-406f-b63d-4894d85f0ffe admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.368199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.368859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.369329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.369611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] PATH_INFO: `/v3/projects/094d36297cc54a3ab080b28e08760574` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.370894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094d36297cc54a3ab080b28e08760574)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.372876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.432220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094d36297cc54a3ab080b28e08760574', 'request_id': 'req-10363f6d-53ae-4870-bf74-aa37b62b4cf4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:34.441890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094d36297cc54a3ab080b28e08760574', 'request_id': 'req-10363f6d-53ae-4870-bf74-aa37b62b4cf4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:34.449743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094d36297cc54a3ab080b28e08760574', 'request_id': 'req-10363f6d-53ae-4870-bf74-aa37b62b4cf4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:34.457301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.462404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] The token cache is being invalidate because project 094d36297cc54a3ab080b28e08760574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:34.462696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:34.463358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-10363f6d-53ae-4870-bf74-aa37b62b4cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:34.464907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 976/1939] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:34 2022] DELETE /identity/v3/projects/094d36297cc54a3ab080b28e08760574 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:34.470440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82b43d-42e4-4f5d-9e30-707ab7a265db None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.470731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82b43d-42e4-4f5d-9e30-707ab7a265db None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.471009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82b43d-42e4-4f5d-9e30-707ab7a265db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.496070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0f82b43d-42e4-4f5d-9e30-707ab7a265db None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:34.498133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0f82b43d-42e4-4f5d-9e30-707ab7a265db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:34.567431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 964/1940] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:34.575838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a40e-e39b-44f7-ad27-a32f0c2cf222 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.576126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a40e-e39b-44f7-ad27-a32f0c2cf222 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.576420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a40e-e39b-44f7-ad27-a32f0c2cf222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.598497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6450a40e-e39b-44f7-ad27-a32f0c2cf222 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:34.599887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6450a40e-e39b-44f7-ad27-a32f0c2cf222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:34.612241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 977/1941] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:34.613835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82b43d-42e4-4f5d-9e30-707ab7a265db None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.624966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82b43d-42e4-4f5d-9e30-707ab7a265db None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.630511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.631348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.632236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.632236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.632803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:34.633729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.637731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.655192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 965/1942] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:34.659845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450a40e-e39b-44f7-ad27-a32f0c2cf222 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.670506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450a40e-e39b-44f7-ad27-a32f0c2cf222 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.675897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.676542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.676817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.677080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.677727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.680157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.717639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 978/1943] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:34 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:34.724082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.737176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7738610-7461-4a36-a0c2-6ec62cc4cca6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.786264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.801736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.802345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.802661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.803052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.803841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.806105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.829423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 966/1944] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:34 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:34.833838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.845457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7364dc-da31-41b7-843c-354a751fe8be admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.850037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.850661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.850935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.851296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.852093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.853801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.867771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 979/1945] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:34.871334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.882231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c5e66-cd20-41ed-82e8-366f11f5d54a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.887000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358385f-5e61-45b7-a5d4-5b32734eaca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.887717 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358385f-5e61-45b7-a5d4-5b32734eaca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.888164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358385f-5e61-45b7-a5d4-5b32734eaca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.888478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358385f-5e61-45b7-a5d4-5b32734eaca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.889137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358385f-5e61-45b7-a5d4-5b32734eaca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.890726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358385f-5e61-45b7-a5d4-5b32734eaca0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.902489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 967/1946] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:34.907017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.917089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a5afe-1276-4ea9-945f-f1257e79424c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.921741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.922639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.922915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.923183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] PATH_INFO: `/v3/projects/3456f1331b094b3694f4a019c75d0bd8/users/66474e9de61b415483d6334ef872675b/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.938946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3456f1331b094b3694f4a019c75d0bd8, user_id=66474e9de61b415483d6334ef872675b, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.943333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.960286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 980/1947] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:34 2022] PUT /identity/v3/projects/3456f1331b094b3694f4a019c75d0bd8/users/66474e9de61b415483d6334ef872675b/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:34.971600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348970-968e-4a35-b7e0-66797c876268 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.972227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348970-968e-4a35-b7e0-66797c876268 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.972505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec348970-968e-4a35-b7e0-66797c876268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.014110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ec348970-968e-4a35-b7e0-66797c876268 None None] MFA Rules not processed for user `66474e9de61b415483d6334ef872675b`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:35.016343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ec348970-968e-4a35-b7e0-66797c876268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:35.092159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 968/1948] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:35.096782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.166604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659076e-3fd0-4580-a5c3-b4f029c788c1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.171578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.173573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.173573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.173573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.173573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.175716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.230180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 981/1949] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:35 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:35.234310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec348970-968e-4a35-b7e0-66797c876268 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.247018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec348970-968e-4a35-b7e0-66797c876268 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.288309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.292351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:35.397657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.398386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.399005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.399326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.400550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.403377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.426603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f95a62-6064-4bd8-9007-2f02f7aa38b0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.438495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 969/1950] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:35 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:35.442222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.443097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.443869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.444209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.444541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] PATH_INFO: `/v3/users/149a10f68b6a40eb9ede5379aa15c3a5` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.445928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] RBAC: Authorizing `identity:delete_user(user_id=149a10f68b6a40eb9ede5379aa15c3a5)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.448146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.458351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bc4ef-3e2e-4255-be45-c2f91caaeda3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.463400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.464056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.464337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.464608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.465325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.466941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.483886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 970/1951] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:35.484113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:35.487110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.506310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce5922-887d-4489-9b22-621c1ed81538 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.516515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.517933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.518337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.518627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] PATH_INFO: `/v3/projects/74fc076f79ea4b7aa2880e47e3de98c9/users/89b0d97aedbd4352aabb4d091f8303d2/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.525837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149a10f68b6a40eb9ede5379aa15c3a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:35.540660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fc076f79ea4b7aa2880e47e3de98c9, user_id=89b0d97aedbd4352aabb4d091f8303d2, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.540988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149a10f68b6a40eb9ede5379aa15c3a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:35.542433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149a10f68b6a40eb9ede5379aa15c3a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:35.543637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.558582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149a10f68b6a40eb9ede5379aa15c3a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:35.563673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 971/1952] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:35 2022] PUT /identity/v3/projects/74fc076f79ea4b7aa2880e47e3de98c9/users/89b0d97aedbd4352aabb4d091f8303d2/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:35.566410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.568895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:35.580554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:35.591104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ceb003d4-2a11-4753-af5f-06e7a7d0b94c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149a10f68b6a40eb9ede5379aa15c3a5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:35.601075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 982/1953] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:35 2022] DELETE /identity/v3/users/149a10f68b6a40eb9ede5379aa15c3a5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:35.605201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.606096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.607825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.636383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:35.637931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:35.652629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d0066-a848-4ecf-b2bd-f5969f5a5e8e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.723857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 983/1954] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:35.730575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.732099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:35.772097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.772821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.773102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.773439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.774101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.776705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.801428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 972/1955] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:35.806179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.818326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ab835-b725-4e7c-b4ed-840a76ff5e50 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.824791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73cace-e7f9-4b9f-93fb-6cbcc36e35be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.825474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73cace-e7f9-4b9f-93fb-6cbcc36e35be admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.825782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73cace-e7f9-4b9f-93fb-6cbcc36e35be admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.826063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73cace-e7f9-4b9f-93fb-6cbcc36e35be admin admin] PATH_INFO: `/v3/projects/74fc076f79ea4b7aa2880e47e3de98c9/users/89b0d97aedbd4352aabb4d091f8303d2/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.827958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73cace-e7f9-4b9f-93fb-6cbcc36e35be admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fc076f79ea4b7aa2880e47e3de98c9, user_id=89b0d97aedbd4352aabb4d091f8303d2, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.830797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73cace-e7f9-4b9f-93fb-6cbcc36e35be admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.847228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 973/1956] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:35 2022] PUT /identity/v3/projects/74fc076f79ea4b7aa2880e47e3de98c9/users/89b0d97aedbd4352aabb4d091f8303d2/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:35.859641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.859931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.860688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.900274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] MFA Rules not processed for user `89b0d97aedbd4352aabb4d091f8303d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:35.901513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:35.910864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580913-f5fb-47b6-86e8-e8fdb22479ea None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.012407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.012995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.013524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.015178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.027264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:36.029887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 974/1957] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:36.048064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.052086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:36.089137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:36.144179 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.146726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.153978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83615f18-f8e8-41fb-ae09-dd504d383f1d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.158704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.158955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 984/1958] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:30:36.159407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.159732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.160110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.173481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.175195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.188644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 975/1959] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:36.328592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.330878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:36.345710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f3a64-5292-4bed-bfbe-c590fbe469b8 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.350969 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09ac76-fc1d-4cc8-a512-5a64ffb3aa83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.355234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ac76-fc1d-4cc8-a512-5a64ffb3aa83 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.355615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ac76-fc1d-4cc8-a512-5a64ffb3aa83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.355959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ac76-fc1d-4cc8-a512-5a64ffb3aa83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.358163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fd09ac76-fc1d-4cc8-a512-5a64ffb3aa83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:36.451874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09ac76-fc1d-4cc8-a512-5a64ffb3aa83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.453802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09ac76-fc1d-4cc8-a512-5a64ffb3aa83 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.466918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 985/1960] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:36.564482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.566297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:36.593448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630910e5-ad4f-4373-a8fa-485ecd2636f2 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.600712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.601723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.602072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.602413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] PATH_INFO: `/v3/projects/d8034bce2e1749bba4fb4b2cbfc3020a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.603749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8034bce2e1749bba4fb4b2cbfc3020a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.606572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.683644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8034bce2e1749bba4fb4b2cbfc3020a', 'request_id': 'req-7c6544b3-6d78-4591-98b8-11ed2ce3def3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:36.690169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8034bce2e1749bba4fb4b2cbfc3020a', 'request_id': 'req-7c6544b3-6d78-4591-98b8-11ed2ce3def3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:36.697555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8034bce2e1749bba4fb4b2cbfc3020a', 'request_id': 'req-7c6544b3-6d78-4591-98b8-11ed2ce3def3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:36.719705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] The token cache is being invalidate because project d8034bce2e1749bba4fb4b2cbfc3020a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:36.719999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:36.720648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7c6544b3-6d78-4591-98b8-11ed2ce3def3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:36.722776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 976/1961] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:36 2022] DELETE /identity/v3/projects/d8034bce2e1749bba4fb4b2cbfc3020a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:36.727864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446ec3-2895-4ae7-bf91-45535793d05b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.728248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446ec3-2895-4ae7-bf91-45535793d05b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.730237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c446ec3-2895-4ae7-bf91-45535793d05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.753011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2c446ec3-2895-4ae7-bf91-45535793d05b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:36.754368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2c446ec3-2895-4ae7-bf91-45535793d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:36.829915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 986/1962] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:36.837739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3670-4230-4e08-a9a0-0b33f0530d48 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.838186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3670-4230-4e08-a9a0-0b33f0530d48 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.838273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3670-4230-4e08-a9a0-0b33f0530d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.861571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8f9b3670-4230-4e08-a9a0-0b33f0530d48 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:36.862812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8f9b3670-4230-4e08-a9a0-0b33f0530d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:36.872139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 977/1963] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:36.876610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c446ec3-2895-4ae7-bf91-45535793d05b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.886867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c446ec3-2895-4ae7-bf91-45535793d05b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.892815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.893582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.893934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.894210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.894910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:36.895224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.896896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.909052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 987/1964] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:36.914031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b3670-4230-4e08-a9a0-0b33f0530d48 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.924991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b3670-4230-4e08-a9a0-0b33f0530d48 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.930534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.931157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.931437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.931772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.932441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.936156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.966590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 978/1965] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:36 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:36.971019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.981555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369738b6-0f61-416a-aa18-d9e111110170 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.019940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:37.054618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.055263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.055559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.055871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.056585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.058556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.088331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 988/1966] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:36 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:37.089336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.100803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe2bab-8c30-471c-ba05-be63d95e232e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.108639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.110401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.111732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.112914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.114167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.116569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.127361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 979/1967] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:37.131491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.141898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64033cd5-e131-471b-88fc-832d1ab7fd09 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.146758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69891cd-d4b2-439e-8b05-2086ae2a7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.147424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69891cd-d4b2-439e-8b05-2086ae2a7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.147731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69891cd-d4b2-439e-8b05-2086ae2a7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.148003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69891cd-d4b2-439e-8b05-2086ae2a7a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.148642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69891cd-d4b2-439e-8b05-2086ae2a7a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.150898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69891cd-d4b2-439e-8b05-2086ae2a7a19 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.162482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 989/1968] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:37.166897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.177266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef6cd-5e84-4100-8f5e-f3be2d672427 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.182213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.182873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.183151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.183424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] PATH_INFO: `/v3/projects/f16e495e0b5a4ed4913d4eb0f59a59cc/users/385c6d8c37ff4414ae193e48d176f895/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.198784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16e495e0b5a4ed4913d4eb0f59a59cc, user_id=385c6d8c37ff4414ae193e48d176f895, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.201515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.217237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 980/1969] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:37 2022] PUT /identity/v3/projects/f16e495e0b5a4ed4913d4eb0f59a59cc/users/385c6d8c37ff4414ae193e48d176f895/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:37.228226 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8546ba-dce2-46aa-9547-a0dedb4daf5c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.228510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8546ba-dce2-46aa-9547-a0dedb4daf5c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.228770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8546ba-dce2-46aa-9547-a0dedb4daf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.260050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fa8546ba-dce2-46aa-9547-a0dedb4daf5c None None] MFA Rules not processed for user `385c6d8c37ff4414ae193e48d176f895`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:37.261283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fa8546ba-dce2-46aa-9547-a0dedb4daf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:37.335942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 990/1970] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:37.340193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.391939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:37.411429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dabac-64c5-4d16-972d-c77e67b2a920 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.415751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.416376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.416652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.416948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.417605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.419525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.449616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 981/1971] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:37 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:37.456041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8546ba-dce2-46aa-9547-a0dedb4daf5c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.468121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8546ba-dce2-46aa-9547-a0dedb4daf5c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.526079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.526687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.526962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.527229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.527898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.529810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.554914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 991/1972] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:37 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:37.559088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.572877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3473b-4d5a-41e7-8152-e5125175c4ec admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.580184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.581155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.581582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.582007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.583048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.585775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.602628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 982/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:37.606923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.617773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1963b-429a-4a59-aed4-90ee175b1671 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.622683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32709d-a426-4534-974c-103a0ea1c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.623288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32709d-a426-4534-974c-103a0ea1c576 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.623571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32709d-a426-4534-974c-103a0ea1c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.623860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32709d-a426-4534-974c-103a0ea1c576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.624511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32709d-a426-4534-974c-103a0ea1c576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.626312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32709d-a426-4534-974c-103a0ea1c576 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.636799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 992/1974] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:37.642107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.652883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69c9b3-c578-4237-9c0e-685a69f9c9df admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.662326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.662987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.663234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.663523 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] PATH_INFO: `/v3/projects/33730a0e5b9a464eac254e571267efb9/users/d9e3d094120e41b590d01bb0d5eaf735/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.681704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33730a0e5b9a464eac254e571267efb9, user_id=d9e3d094120e41b590d01bb0d5eaf735, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.685860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.704229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 983/1975] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:37 2022] PUT /identity/v3/projects/33730a0e5b9a464eac254e571267efb9/users/d9e3d094120e41b590d01bb0d5eaf735/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:37.715976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82488403-1720-4655-be03-43ceefefcba8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.716270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82488403-1720-4655-be03-43ceefefcba8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.716565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82488403-1720-4655-be03-43ceefefcba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.747006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-82488403-1720-4655-be03-43ceefefcba8 None None] MFA Rules not processed for user `d9e3d094120e41b590d01bb0d5eaf735`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:37.748156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-82488403-1720-4655-be03-43ceefefcba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:37.754234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:37.821153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 993/1976] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:37.825861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.893783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f1a2f-9e2b-4cbc-ae5c-e9377d8b9035 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.900988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.901611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.901916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.902311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.902822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:37.904940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:37.935277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 984/1977] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:37 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:37.939795 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82488403-1720-4655-be03-43ceefefcba8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.959381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82488403-1720-4655-be03-43ceefefcba8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.037996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.038537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.039026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.039171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.039840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.041930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.067753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 994/1978] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:37 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:38.068951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.080183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d6b4c-534f-418b-af13-8895d968da49 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.085580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.086137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.086415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.086752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.087438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.089141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.101671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 985/1979] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:38.106695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.121027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b8b35-4254-421b-a021-5a2063288637 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.126331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.127003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.127359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.127557 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] PATH_INFO: `/v3/projects/4220c06ed7ab466ab141d6228b1825ec/users/1dace1fcac43444b90b17e7f2743af9c/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.146846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4220c06ed7ab466ab141d6228b1825ec, user_id=1dace1fcac43444b90b17e7f2743af9c, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.149651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.176516 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 995/1980] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:38 2022] PUT /identity/v3/projects/4220c06ed7ab466ab141d6228b1825ec/users/1dace1fcac43444b90b17e7f2743af9c/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:38.181553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.192267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1ac7c-ed43-4b80-8f82-4129d273a111 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.256406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0d00d-d08b-4552-951a-06e050b8dc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.256921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d00d-d08b-4552-951a-06e050b8dc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.257196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d00d-d08b-4552-951a-06e050b8dc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.257463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0d00d-d08b-4552-951a-06e050b8dc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.258134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0d00d-d08b-4552-951a-06e050b8dc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.260257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0d00d-d08b-4552-951a-06e050b8dc1f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.270051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 986/1981] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:38.274631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.286419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457b38d-ff26-4cb8-8080-c888a195029a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.291979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.292651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.292929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.293201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] PATH_INFO: `/v3/projects/4220c06ed7ab466ab141d6228b1825ec/users/1dace1fcac43444b90b17e7f2743af9c/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.296618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4220c06ed7ab466ab141d6228b1825ec, user_id=1dace1fcac43444b90b17e7f2743af9c, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.305812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.319722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 996/1982] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:38 2022] PUT /identity/v3/projects/4220c06ed7ab466ab141d6228b1825ec/users/1dace1fcac43444b90b17e7f2743af9c/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:38.330458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.330881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.331256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.352012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:38.370825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] MFA Rules not processed for user `1dace1fcac43444b90b17e7f2743af9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:38.372827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:38.466124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 987/1983] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:38.482413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.484543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:38.578540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22fcb1-ae8b-4723-88f5-bae1b7be1829 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.583108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68015fc5-d295-47f9-b5c2-24f7feb730f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.583901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015fc5-d295-47f9-b5c2-24f7feb730f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.584460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015fc5-d295-47f9-b5c2-24f7feb730f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.584784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68015fc5-d295-47f9-b5c2-24f7feb730f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.603499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:38.699286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68015fc5-d295-47f9-b5c2-24f7feb730f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.701304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68015fc5-d295-47f9-b5c2-24f7feb730f2 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.713932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 997/1984] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:39.198955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:39.201952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:39.293375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd551f7d-c67c-4f0b-9a2e-0b2512dd8f71 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:39.303499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:39.304540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.304817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.305089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] PATH_INFO: `/v3/users/66474e9de61b415483d6334ef872675b` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.306960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66474e9de61b415483d6334ef872675b)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:39.309071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:39.384495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66474e9de61b415483d6334ef872675b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:39.397189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66474e9de61b415483d6334ef872675b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:39.433470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66474e9de61b415483d6334ef872675b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:39.434415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66474e9de61b415483d6334ef872675b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:39.448760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66474e9de61b415483d6334ef872675b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:39.459096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 988/1985] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:39 2022] DELETE /identity/v3/users/66474e9de61b415483d6334ef872675b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:39.463577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.464334 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.464620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.518155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:39.520062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:39.623947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 998/1986] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:39.636288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:39.638994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:39.660099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:39.723431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857236fb-9184-4429-b9cf-1e3cf13979d5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:39.727582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:39.728238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.728521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.728798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.739410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:39.740894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:39.753459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 989/1987] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:40.077310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.080991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:40.095098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e3f9c-86e0-4c56-aaa6-73b830fad800 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.104213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.105164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.105507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.105888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] PATH_INFO: `/v3/projects/3456f1331b094b3694f4a019c75d0bd8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.107141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3456f1331b094b3694f4a019c75d0bd8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.109891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.257908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3456f1331b094b3694f4a019c75d0bd8', 'request_id': 'req-71ab4db9-502a-44e1-ae12-72dd851543c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.281611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3456f1331b094b3694f4a019c75d0bd8', 'request_id': 'req-71ab4db9-502a-44e1-ae12-72dd851543c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.305513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3456f1331b094b3694f4a019c75d0bd8', 'request_id': 'req-71ab4db9-502a-44e1-ae12-72dd851543c3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.340631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] The token cache is being invalidate because project 3456f1331b094b3694f4a019c75d0bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:40.340948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.342703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.346177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 999/1988] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:40 2022] DELETE /identity/v3/projects/3456f1331b094b3694f4a019c75d0bd8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:40.350237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.366578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fbb28-9e38-4e8b-aae2-ab3f9ceba44b service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.510756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.511771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.519859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.520206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] PATH_INFO: `/v3/users/89b0d97aedbd4352aabb4d091f8303d2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.532484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b0d97aedbd4352aabb4d091f8303d2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.537116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.574526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.576329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:40.666634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b0d97aedbd4352aabb4d091f8303d2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.682814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:40.691146 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b0d97aedbd4352aabb4d091f8303d2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.724600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4db9-502a-44e1-ae12-72dd851543c3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.733018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def95d4-1f9b-4fce-aa86-f4b6039c16a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.733660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def95d4-1f9b-4fce-aa86-f4b6039c16a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.733944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def95d4-1f9b-4fce-aa86-f4b6039c16a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.734299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def95d4-1f9b-4fce-aa86-f4b6039c16a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.739270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b0d97aedbd4352aabb4d091f8303d2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.740344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b0d97aedbd4352aabb4d091f8303d2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.744748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3def95d4-1f9b-4fce-aa86-f4b6039c16a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:40.759314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b0d97aedbd4352aabb4d091f8303d2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:40.771898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 990/1989] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:40 2022] DELETE /identity/v3/users/89b0d97aedbd4352aabb4d091f8303d2 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:40.841293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def95d4-1f9b-4fce-aa86-f4b6039c16a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.842957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def95d4-1f9b-4fce-aa86-f4b6039c16a0 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.853817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1000/1990] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:41.370767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.372796 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:41.512248 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.601386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333393c0-7448-400c-8a24-c3ea01d75b25 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.608551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.610178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.610647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.611215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] PATH_INFO: `/v3/projects/74fc076f79ea4b7aa2880e47e3de98c9` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.612690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74fc076f79ea4b7aa2880e47e3de98c9)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.614878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.700626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74fc076f79ea4b7aa2880e47e3de98c9', 'request_id': 'req-96bd25fb-c72d-4d2e-897f-6abb55ac1256'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:41.707863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74fc076f79ea4b7aa2880e47e3de98c9', 'request_id': 'req-96bd25fb-c72d-4d2e-897f-6abb55ac1256'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:41.717278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74fc076f79ea4b7aa2880e47e3de98c9', 'request_id': 'req-96bd25fb-c72d-4d2e-897f-6abb55ac1256'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:41.745747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] The token cache is being invalidate because project 74fc076f79ea4b7aa2880e47e3de98c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:41.750384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:41.751189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-96bd25fb-c72d-4d2e-897f-6abb55ac1256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:41.753679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 991/1991] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:41 2022] DELETE /identity/v3/projects/74fc076f79ea4b7aa2880e47e3de98c9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:41.758426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.758907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.758984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.784280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:41.785631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:41.872996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1001/1992] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:41.881507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8ad3-d2d7-4a40-bcb1-478ef751da5a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.882197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8ad3-d2d7-4a40-bcb1-478ef751da5a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.882653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8ad3-d2d7-4a40-bcb1-478ef751da5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.897448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.899294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:41.909497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b7bc8ad3-d2d7-4a40-bcb1-478ef751da5a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:41.910901 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b7bc8ad3-d2d7-4a40-bcb1-478ef751da5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:41.920303 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 992/1993] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:41.924503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8ad3-d2d7-4a40-bcb1-478ef751da5a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.937275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8ad3-d2d7-4a40-bcb1-478ef751da5a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.948441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.949754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.950445 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.950943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.951762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:41.952148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.954208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.970472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 993/1994] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:41.974810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.978398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ca8b-43c0-4330-8f7f-156475eb9884 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.985441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.986168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.986733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.987077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.989657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:41.995261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475febd-525e-45f0-a819-9e3ee4932adf admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.003140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.004176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.004689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.005143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.005941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.009954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.063285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 994/1995] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:41 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:42.064910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.107622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:42.151231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.153895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.179361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84c71-c257-42cb-aaeb-2e9ff4d621d9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.182910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1002/1996] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:42.188066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.188819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.189193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.189557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.190380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.193026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.227730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 995/1997] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:42 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:42.233896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.250409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e44ec9-c276-487c-a859-237ad9bccd55 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.258984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.259776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.260050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.260507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.261039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.262591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.275625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1003/1998] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:42.281221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.303329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78708c3f-b8af-4cc5-95c4-d548e0a5b5ed admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.311278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff6b06-c0fb-4df0-9d2b-4c0915fc0e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.314247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6b06-c0fb-4df0-9d2b-4c0915fc0e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.314858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6b06-c0fb-4df0-9d2b-4c0915fc0e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.315038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff6b06-c0fb-4df0-9d2b-4c0915fc0e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.316946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff6b06-c0fb-4df0-9d2b-4c0915fc0e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.317394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff6b06-c0fb-4df0-9d2b-4c0915fc0e73 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.331887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:42.344414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 996/1999] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:42.346031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.362364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9642b21-db69-449c-9ded-5aa77135b550 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.394713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.395277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.395839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.395961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] PATH_INFO: `/v3/projects/e0cb0ef2966d4e18aa03d20d71e15964/users/d8b57c54782a4aecafbd57a5cca59a8b/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.431148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cb0ef2966d4e18aa03d20d71e15964, user_id=d8b57c54782a4aecafbd57a5cca59a8b, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.434416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.457539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1004/2000] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:42 2022] PUT /identity/v3/projects/e0cb0ef2966d4e18aa03d20d71e15964/users/d8b57c54782a4aecafbd57a5cca59a8b/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:42.470893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701342d-13f9-4ee0-a449-9ca4b3e1ddc5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.471487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701342d-13f9-4ee0-a449-9ca4b3e1ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.471487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701342d-13f9-4ee0-a449-9ca4b3e1ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.535024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0701342d-13f9-4ee0-a449-9ca4b3e1ddc5 None None] MFA Rules not processed for user `d8b57c54782a4aecafbd57a5cca59a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:42.536426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0701342d-13f9-4ee0-a449-9ca4b3e1ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:42.695782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 997/2001] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:42.701276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.830993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811adc2-aa89-4de1-a64b-feb700b3f8cf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.848138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.848834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.849448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.850120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.851031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.853360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.893841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1005/2002] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:42 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:42.898448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701342d-13f9-4ee0-a449-9ca4b3e1ddc5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.911489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701342d-13f9-4ee0-a449-9ca4b3e1ddc5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.004616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.005365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.005650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.006078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.006916 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.009990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.035377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 998/2003] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:42 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:43.039503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.056182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9934-c0bc-436b-bb05-4d227029b29e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.061584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.062477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.062752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.063015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.063742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.067720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.083223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1006/2004] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:43.084401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.096433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07be497-dd99-40d5-83f6-db3356a07e76 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.103487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3787-1d58-472f-816b-8d0b6e7ebe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.104162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3787-1d58-472f-816b-8d0b6e7ebe00 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.104444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3787-1d58-472f-816b-8d0b6e7ebe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.105168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3787-1d58-472f-816b-8d0b6e7ebe00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.105550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3787-1d58-472f-816b-8d0b6e7ebe00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.107910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3787-1d58-472f-816b-8d0b6e7ebe00 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.123691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 999/2005] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:43.125411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.136489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219e211-26f6-4815-857d-7c8b7259a9a0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.141656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.142328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.142605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.142878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] PATH_INFO: `/v3/projects/a630e9bfd9cd41efb530691b727c6b65/users/0643538c1f6b4eccbd89911bb38f18b3/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.163883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a630e9bfd9cd41efb530691b727c6b65, user_id=0643538c1f6b4eccbd89911bb38f18b3, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.166800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.183791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1007/2006] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:43 2022] PUT /identity/v3/projects/a630e9bfd9cd41efb530691b727c6b65/users/0643538c1f6b4eccbd89911bb38f18b3/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:43.194509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918d1f-1fa6-40ef-a60c-4d52ac6325f2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.194791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918d1f-1fa6-40ef-a60c-4d52ac6325f2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.195062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2918d1f-1fa6-40ef-a60c-4d52ac6325f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.233885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f2918d1f-1fa6-40ef-a60c-4d52ac6325f2 None None] MFA Rules not processed for user `0643538c1f6b4eccbd89911bb38f18b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:43.235476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f2918d1f-1fa6-40ef-a60c-4d52ac6325f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:43.309553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:43.316767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1000/2007] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:43.321579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.388605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:43.396263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f6e26-f4c3-4529-9448-df260321cf03 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.404088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.406550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.406975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.407426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.408895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.414266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.488838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1008/2008] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:43 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:43.491054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2918d1f-1fa6-40ef-a60c-4d52ac6325f2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.522159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2918d1f-1fa6-40ef-a60c-4d52ac6325f2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.606328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.607027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.607720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.608000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.609318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.612324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.637263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1001/2009] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:43 2022] POST /identity/v3/users => generated 296 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:43.641299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.652579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38553ca-0ab0-485f-92ab-584ecccad9e0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.659165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.660116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.660641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.661030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.662104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.663751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.676680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1009/2010] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:43.681951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.696902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb715066-4111-4e80-a00b-dbde8959f765 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.706065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.707664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.708098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.708562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] PATH_INFO: `/v3/projects/2cbf9b8aa18643e594b9abb533365a6c/users/1d6859ed57984670907fbcfc7cc622b7/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.729621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbf9b8aa18643e594b9abb533365a6c, user_id=1d6859ed57984670907fbcfc7cc622b7, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.733594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.760261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1002/2011] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:43 2022] PUT /identity/v3/projects/2cbf9b8aa18643e594b9abb533365a6c/users/1d6859ed57984670907fbcfc7cc622b7/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:43.767722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.778648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcecd9-b3f6-46d4-87de-b864d57adf73 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.917625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a1d34-03c1-40df-a1a0-2f586daa52bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.918400 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1d34-03c1-40df-a1a0-2f586daa52bd admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.918568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1d34-03c1-40df-a1a0-2f586daa52bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.918838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a1d34-03c1-40df-a1a0-2f586daa52bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.919699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a1d34-03c1-40df-a1a0-2f586daa52bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.921896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a1d34-03c1-40df-a1a0-2f586daa52bd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.933521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1010/2012] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:43.938511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.956828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4c7c-98a5-44cb-9cbc-9a175ba2d6a0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.961739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.962545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.963015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.964015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] PATH_INFO: `/v3/projects/2cbf9b8aa18643e594b9abb533365a6c/users/1d6859ed57984670907fbcfc7cc622b7/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.965596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbf9b8aa18643e594b9abb533365a6c, user_id=1d6859ed57984670907fbcfc7cc622b7, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.969173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.985401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1003/2013] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:43 2022] PUT /identity/v3/projects/2cbf9b8aa18643e594b9abb533365a6c/users/1d6859ed57984670907fbcfc7cc622b7/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:43.997236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dc012-8a81-48b3-b986-9675c46513a6 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.997236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dc012-8a81-48b3-b986-9675c46513a6 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.997236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3dc012-8a81-48b3-b986-9675c46513a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.044714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-dc3dc012-8a81-48b3-b986-9675c46513a6 None None] MFA Rules not processed for user `1d6859ed57984670907fbcfc7cc622b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:44.050251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dc3dc012-8a81-48b3-b986-9675c46513a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:44.156726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1011/2014] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:44.168557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.171712 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:44.258995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8371bfc-170d-4489-8fe7-265e4820e2d2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.265366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.268385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.268385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.268385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.283615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.283929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.300520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1004/2015] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:44.368702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dc012-8a81-48b3-b986-9675c46513a6 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.380615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3dc012-8a81-48b3-b986-9675c46513a6 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.384624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b778332-bbea-4860-a3b4-8eb3c5f6bf9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.385476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b778332-bbea-4860-a3b4-8eb3c5f6bf9e service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.385881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b778332-bbea-4860-a3b4-8eb3c5f6bf9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.386136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b778332-bbea-4860-a3b4-8eb3c5f6bf9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.458315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:44.472351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b778332-bbea-4860-a3b4-8eb3c5f6bf9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.474519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b778332-bbea-4860-a3b4-8eb3c5f6bf9e service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.488444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1012/2016] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:47.643853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:47.645460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:47.714476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:47.731680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d167ff-0bf7-4ef1-92bf-0b24db0bd522 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:47.737231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:47.737882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.738161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.739274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] PATH_INFO: `/v3/users/385c6d8c37ff4414ae193e48d176f895` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.740473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385c6d8c37ff4414ae193e48d176f895)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:47.742435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:47.812520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385c6d8c37ff4414ae193e48d176f895'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:47.828355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385c6d8c37ff4414ae193e48d176f895'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:47.846656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385c6d8c37ff4414ae193e48d176f895'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:47.847532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385c6d8c37ff4414ae193e48d176f895'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:47.858578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385c6d8c37ff4414ae193e48d176f895'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:47.868665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1005/2017] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:47 2022] DELETE /identity/v3/users/385c6d8c37ff4414ae193e48d176f895 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:47.873186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.873631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.873899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.904841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:47.907522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:48.033225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.034434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:48.041598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1013/2018] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:48.168420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29de87c-8e3b-4333-b1fa-8a62990bca11 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.172994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.173627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.173913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.175866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.193840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:48.195536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:48.215737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1006/2019] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:30:48.742874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.744353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:48.759083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e536de5-df83-4af1-a08c-6fba4da3c36d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.764906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.765640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.765922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.767054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] PATH_INFO: `/v3/users/d8b57c54782a4aecafbd57a5cca59a8b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.769300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b57c54782a4aecafbd57a5cca59a8b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:48.771495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:48.846208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b57c54782a4aecafbd57a5cca59a8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:48.859754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b57c54782a4aecafbd57a5cca59a8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:48.860587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b57c54782a4aecafbd57a5cca59a8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:48.868263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.869509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b57c54782a4aecafbd57a5cca59a8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:48.869634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:48.883210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf87f8-f233-4e07-b491-d10b8a6a2b7a service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.884694 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d6568491-6743-48a8-a1a5-a8ecd2e9835f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b57c54782a4aecafbd57a5cca59a8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:48.889129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.889975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.890375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.890720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] PATH_INFO: `/v3/projects/f16e495e0b5a4ed4913d4eb0f59a59cc` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.892714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16e495e0b5a4ed4913d4eb0f59a59cc)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:48.895051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:48.904118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1014/2020] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:48 2022] DELETE /identity/v3/users/d8b57c54782a4aecafbd57a5cca59a8b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:48.907507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.908028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.908570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.952003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:48.953618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:48.980270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16e495e0b5a4ed4913d4eb0f59a59cc', 'request_id': 'req-79fadb0b-a044-4619-935e-474a5c3394e3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:48.990549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16e495e0b5a4ed4913d4eb0f59a59cc', 'request_id': 'req-79fadb0b-a044-4619-935e-474a5c3394e3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.000243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16e495e0b5a4ed4913d4eb0f59a59cc', 'request_id': 'req-79fadb0b-a044-4619-935e-474a5c3394e3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.023220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:49.037018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] The token cache is being invalidate because project f16e495e0b5a4ed4913d4eb0f59a59cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:49.038169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.039137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.041021 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1007/2021] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:48 2022] DELETE /identity/v3/projects/f16e495e0b5a4ed4913d4eb0f59a59cc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:49.045739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.054309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1015/2022] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:49.055754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:49.064613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.066453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:49.074103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fadb0b-a044-4619-935e-474a5c3394e3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.077285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:49.082171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.083251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.083251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.083465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] PATH_INFO: `/v3/users/d9e3d094120e41b590d01bb0d5eaf735` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.084650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e3d094120e41b590d01bb0d5eaf735)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.087415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.151853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438aa30-d98e-4b92-92eb-044422ebce18 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.158586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.159615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.160114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.160356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.182233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e3d094120e41b590d01bb0d5eaf735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.190080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.191799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.202396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e3d094120e41b590d01bb0d5eaf735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.215340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1016/2023] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:49.236442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e3d094120e41b590d01bb0d5eaf735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.237954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e3d094120e41b590d01bb0d5eaf735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.257400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e3d094120e41b590d01bb0d5eaf735'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:49.270927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1008/2024] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:49 2022] DELETE /identity/v3/users/d9e3d094120e41b590d01bb0d5eaf735 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:49.810918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.812559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:49.827408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9a34-4eeb-42d6-9ed9-78f8337c6a6e service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.840289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.841720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:49.915831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.917100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.917812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.917812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] PATH_INFO: `/v3/projects/e0cb0ef2966d4e18aa03d20d71e15964` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.918931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cb0ef2966d4e18aa03d20d71e15964)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.920928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.941177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d8d24-cb94-4787-a5a4-0340d143b06d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.948232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.949031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.949436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.949676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] PATH_INFO: `/v3/projects/33730a0e5b9a464eac254e571267efb9` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.951285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33730a0e5b9a464eac254e571267efb9)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.953702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.996777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cb0ef2966d4e18aa03d20d71e15964', 'request_id': 'req-26745c6f-04e9-45a5-af21-ba27743293dd'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.011136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cb0ef2966d4e18aa03d20d71e15964', 'request_id': 'req-26745c6f-04e9-45a5-af21-ba27743293dd'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.019448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cb0ef2966d4e18aa03d20d71e15964', 'request_id': 'req-26745c6f-04e9-45a5-af21-ba27743293dd'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.033157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] The token cache is being invalidate because project e0cb0ef2966d4e18aa03d20d71e15964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:50.033457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.034107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.038644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33730a0e5b9a464eac254e571267efb9', 'request_id': 'req-8907c4ea-663c-49b0-8345-543642fecf30'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.038802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1017/2025] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:49 2022] DELETE /identity/v3/projects/e0cb0ef2966d4e18aa03d20d71e15964 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:50.039682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.041711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:50.045718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33730a0e5b9a464eac254e571267efb9', 'request_id': 'req-8907c4ea-663c-49b0-8345-543642fecf30'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.055476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33730a0e5b9a464eac254e571267efb9', 'request_id': 'req-8907c4ea-663c-49b0-8345-543642fecf30'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.070509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.076487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] The token cache is being invalidate because project 33730a0e5b9a464eac254e571267efb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:50.076812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.077494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.079309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1009/2026] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:49 2022] DELETE /identity/v3/projects/33730a0e5b9a464eac254e571267efb9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:50.083699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.087121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:50.113921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.161507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26745c6f-04e9-45a5-af21-ba27743293dd admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.214666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c4ea-663c-49b0-8345-543642fecf30 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.225872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.226837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.227223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.227614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] PATH_INFO: `/v3/users/1dace1fcac43444b90b17e7f2743af9c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.228907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dace1fcac43444b90b17e7f2743af9c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.230846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.249471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.250409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.250874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.251209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] PATH_INFO: `/v3/users/0643538c1f6b4eccbd89911bb38f18b3` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.252546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0643538c1f6b4eccbd89911bb38f18b3)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.254575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.303497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dace1fcac43444b90b17e7f2743af9c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.316034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dace1fcac43444b90b17e7f2743af9c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.326997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0643538c1f6b4eccbd89911bb38f18b3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.333240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dace1fcac43444b90b17e7f2743af9c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.334085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dace1fcac43444b90b17e7f2743af9c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.340288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0643538c1f6b4eccbd89911bb38f18b3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.343940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0643538c1f6b4eccbd89911bb38f18b3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.349967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dace1fcac43444b90b17e7f2743af9c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.353477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0643538c1f6b4eccbd89911bb38f18b3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.358061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1010/2027] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:50 2022] DELETE /identity/v3/users/1dace1fcac43444b90b17e7f2743af9c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:50.371965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0643538c1f6b4eccbd89911bb38f18b3'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:50.382988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1018/2028] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:50 2022] DELETE /identity/v3/users/0643538c1f6b4eccbd89911bb38f18b3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:50.886342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.888839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:50.978852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef6f01-2e15-4c35-b1d6-23037ce6cf5b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.982732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.985267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.018908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.066995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.067781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.068136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.068478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] PATH_INFO: `/v3/projects/4220c06ed7ab466ab141d6228b1825ec` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.069799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4220c06ed7ab466ab141d6228b1825ec)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.071785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.086836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a5848-6971-4700-b620-2df70253e3ae admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.094689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.095432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.095823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.096095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] PATH_INFO: `/v3/projects/a630e9bfd9cd41efb530691b727c6b65` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.097257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a630e9bfd9cd41efb530691b727c6b65)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.099168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.106235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.129191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4220c06ed7ab466ab141d6228b1825ec', 'request_id': 'req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.136458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4220c06ed7ab466ab141d6228b1825ec', 'request_id': 'req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.144345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4220c06ed7ab466ab141d6228b1825ec', 'request_id': 'req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.160174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] The token cache is being invalidate because project 4220c06ed7ab466ab141d6228b1825ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:51.160462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.161183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-da5a9b0e-4fac-4557-90d1-5da04a66fc2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.162478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a630e9bfd9cd41efb530691b727c6b65', 'request_id': 'req-5fde089d-291b-4d1e-ab03-8b049837aca8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.162817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1011/2029] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:50 2022] DELETE /identity/v3/projects/4220c06ed7ab466ab141d6228b1825ec => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:51.171098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62610478-2fe9-4d4c-b053-f5e0e301817b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.171381 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62610478-2fe9-4d4c-b053-f5e0e301817b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.171849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62610478-2fe9-4d4c-b053-f5e0e301817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.174052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a630e9bfd9cd41efb530691b727c6b65', 'request_id': 'req-5fde089d-291b-4d1e-ab03-8b049837aca8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.183970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a630e9bfd9cd41efb530691b727c6b65', 'request_id': 'req-5fde089d-291b-4d1e-ab03-8b049837aca8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.196566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-62610478-2fe9-4d4c-b053-f5e0e301817b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:51.198182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-62610478-2fe9-4d4c-b053-f5e0e301817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.198856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] The token cache is being invalidate because project a630e9bfd9cd41efb530691b727c6b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:51.199440 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.200193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.202366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1019/2030] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:50 2022] DELETE /identity/v3/projects/a630e9bfd9cd41efb530691b727c6b65 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:51.206243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.210558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.261803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1012/2031] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:51.270697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe72a7-1aa5-4d09-879c-02244248ce28 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.271011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe72a7-1aa5-4d09-879c-02244248ce28 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.271287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe72a7-1aa5-4d09-879c-02244248ce28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.284370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde089d-291b-4d1e-ab03-8b049837aca8 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.292327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.293355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.293637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.293994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] PATH_INFO: `/v3/users/1d6859ed57984670907fbcfc7cc622b7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.295357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6859ed57984670907fbcfc7cc622b7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.297711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.302968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9bfe72a7-1aa5-4d09-879c-02244248ce28 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:51.305933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9bfe72a7-1aa5-4d09-879c-02244248ce28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.317753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1013/2032] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:51.322371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe72a7-1aa5-4d09-879c-02244248ce28 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.332268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe72a7-1aa5-4d09-879c-02244248ce28 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.338027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.339295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.340202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.341400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.342352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:51.342854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.345335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.355021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6859ed57984670907fbcfc7cc622b7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.363585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1014/2033] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:51.365688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.368398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6859ed57984670907fbcfc7cc622b7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.369142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6859ed57984670907fbcfc7cc622b7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.377643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6859ed57984670907fbcfc7cc622b7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.379431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d2b8f-090b-4a82-bbd9-80aaabdb3b52 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.386367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.387114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.387468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.387773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.388526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.390654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.396840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6859ed57984670907fbcfc7cc622b7'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.405596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1020/2034] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:51 2022] DELETE /identity/v3/users/1d6859ed57984670907fbcfc7cc622b7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:51.443446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1015/2035] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:51 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:51.448849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.451169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.468732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.549782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ed805-da72-476f-88ea-00e538975a6a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.618285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.618972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.619168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.619438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.620176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.622083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.648713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1021/2036] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:51 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:51.652724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.664164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d55237-2b37-48b3-b6cf-42c3c2c3bfd6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.671925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.673212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.673491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.673761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.674412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.676261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.691951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1016/2037] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:51.695069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.708558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694f5f7-75a4-4142-bbe0-009f361cc431 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.716807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.717436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.717758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.717904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.718076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.718978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.719674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.720866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.731372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.736110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33fe25-ce2c-46c4-8b93-07b794540030 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.743119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.744189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.747651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1022/2038] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:51.747651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.748262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.765308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.765308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] PATH_INFO: `/v3/users/174fd621eac446e5b8f7b6445b5558a4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.766616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b253e0a-aa81-4f83-9ac0-553ea5aeac7c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.767538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=174fd621eac446e5b8f7b6445b5558a4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.770087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.774473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.775135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.775413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.775718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] PATH_INFO: `/v3/projects/2cbf9b8aa18643e594b9abb533365a6c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.777026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbf9b8aa18643e594b9abb533365a6c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.778938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.824574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174fd621eac446e5b8f7b6445b5558a4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.834229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174fd621eac446e5b8f7b6445b5558a4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.840266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbf9b8aa18643e594b9abb533365a6c', 'request_id': 'req-9bb39d17-415d-4bd0-a746-6a66ab2d672f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.848915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174fd621eac446e5b8f7b6445b5558a4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.849711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174fd621eac446e5b8f7b6445b5558a4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.857030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174fd621eac446e5b8f7b6445b5558a4'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.863891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbf9b8aa18643e594b9abb533365a6c', 'request_id': 'req-9bb39d17-415d-4bd0-a746-6a66ab2d672f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.865951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1017/2039] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:30:51 2022] DELETE /identity/v3/users/174fd621eac446e5b8f7b6445b5558a4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:51.866854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.868400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.875051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbf9b8aa18643e594b9abb533365a6c', 'request_id': 'req-9bb39d17-415d-4bd0-a746-6a66ab2d672f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.886608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] The token cache is being invalidate because project 2cbf9b8aa18643e594b9abb533365a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:51.886896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.887598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9bb39d17-415d-4bd0-a746-6a66ab2d672f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:51.889130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1023/2040] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:51 2022] DELETE /identity/v3/projects/2cbf9b8aa18643e594b9abb533365a6c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:51.890456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513f58-23f3-420a-b96d-6447df9873b7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.890755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513f58-23f3-420a-b96d-6447df9873b7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.891122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513f58-23f3-420a-b96d-6447df9873b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.910661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b2513f58-23f3-420a-b96d-6447df9873b7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:51.911910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b2513f58-23f3-420a-b96d-6447df9873b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.931127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.940052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977d7d-e406-47d3-ba3b-e1911f9d4b2a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.946504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.947183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.947460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.947763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] PATH_INFO: `/v3/projects/02223a98b9734710a768b9885ca3afed/users/c7608d3fd5764366ac94f1f21784b636/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.965586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02223a98b9734710a768b9885ca3afed, user_id=c7608d3fd5764366ac94f1f21784b636, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.969703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.977462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1024/2041] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:51.978803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895e7e4-dbe2-438d-a0c9-bc39914571b1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.979021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895e7e4-dbe2-438d-a0c9-bc39914571b1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.979325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895e7e4-dbe2-438d-a0c9-bc39914571b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.994958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1018/2042] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:51 2022] PUT /identity/v3/projects/02223a98b9734710a768b9885ca3afed/users/c7608d3fd5764366ac94f1f21784b636/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:51.996543 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.000080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:52.008553 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0895e7e4-dbe2-438d-a0c9-bc39914571b1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:52.010268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0895e7e4-dbe2-438d-a0c9-bc39914571b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:52.083380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c0939f-cd93-4621-a2f4-85dac2c2eb4e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.089009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.089669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.089947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.090219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.106150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1025/2043] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:52.107794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347078-66d4-4ef7-b2cd-dc756feb49b2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.108078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347078-66d4-4ef7-b2cd-dc756feb49b2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.108348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347078-66d4-4ef7-b2cd-dc756feb49b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.116556 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.135028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-82347078-66d4-4ef7-b2cd-dc756feb49b2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:52.136878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-82347078-66d4-4ef7-b2cd-dc756feb49b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:52.149420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1026/2044] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:52.151750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453716f-a438-456a-884b-c19190266361 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.152172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453716f-a438-456a-884b-c19190266361 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.152760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453716f-a438-456a-884b-c19190266361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.182309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9453716f-a438-456a-884b-c19190266361 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:52.183682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9453716f-a438-456a-884b-c19190266361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:52.193003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1027/2045] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:52.193518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.193828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453716f-a438-456a-884b-c19190266361 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.195018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.195120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9453716f-a438-456a-884b-c19190266361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:52.205692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1019/2046] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:52.206521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.208443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453716f-a438-456a-884b-c19190266361 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.212689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.214049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.214843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.215311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.217207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bba087-d5f1-4b7a-bc2a-7442a2245b98 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.223721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.224314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.224592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.224870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.225620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:52.225818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.227407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.228773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.230575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.245909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1020/2047] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:52.246113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1028/2048] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:52.246249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.256920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad104cbe-e13f-4cf3-a2b8-df342575ece3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.262894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.263508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.263875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.264071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.264872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.267297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.312585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1021/2049] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:52.316852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.330446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941e4db-5e7a-415c-bca1-b5713e6edb8c service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.397515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.398360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.398641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.398924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.399601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.401539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.425691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1029/2050] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:52.429964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.441191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f51936-a0cd-4d34-9529-c95f476afdad admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.446488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.447182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.447569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.447917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.448666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.450715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.462105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1022/2051] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:52.466441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.476993 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0dacc0-eb6a-4ee9-a55d-33b93880747d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.482252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762546a-f0a9-4efb-ac6d-cfed83572486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.482868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762546a-f0a9-4efb-ac6d-cfed83572486 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.483141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762546a-f0a9-4efb-ac6d-cfed83572486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.483411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762546a-f0a9-4efb-ac6d-cfed83572486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.484312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762546a-f0a9-4efb-ac6d-cfed83572486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.485942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762546a-f0a9-4efb-ac6d-cfed83572486 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.497072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1030/2052] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:52.501062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.511675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352df3-de9e-401d-8a16-6185060ba2bc admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.516621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.517318 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.517596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.517865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] PATH_INFO: `/v3/projects/62b639d257984e9994f5b2d330758413/users/a747fb1ee5af4e2d98aed4c75030a11d/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.533278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b639d257984e9994f5b2d330758413, user_id=a747fb1ee5af4e2d98aed4c75030a11d, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.536035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.552122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1023/2053] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:52 2022] PUT /identity/v3/projects/62b639d257984e9994f5b2d330758413/users/a747fb1ee5af4e2d98aed4c75030a11d/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:52.564042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.564314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.564588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.594620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] MFA Rules not processed for user `a747fb1ee5af4e2d98aed4c75030a11d`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:52.596089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:52.600388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.673835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1031/2054] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:52.679265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.693388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.695502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:52.757700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901a1ac-269b-4373-ba7d-45467352fb3b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.763455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.764410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.764853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.765446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.766306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.768546 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.804353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1024/2055] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:52.804488 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a99d1-d625-42c3-b0b1-8c1dec304580 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.808892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.843353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.870716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.871359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.871671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.872272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] PATH_INFO: `/v3/projects/e0fb89d7e4f04af88c80c308d0351168` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.873107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fb89d7e4f04af88c80c308d0351168)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.875046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.916144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0349-0693-4419-a39a-77fd694e5331 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.923665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.925724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.925724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.925724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.926045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.928275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.936573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fb89d7e4f04af88c80c308d0351168', 'request_id': 'req-df9db08a-ed46-42ac-8a69-324d67359c39'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:52.941946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.951510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fb89d7e4f04af88c80c308d0351168', 'request_id': 'req-df9db08a-ed46-42ac-8a69-324d67359c39'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:52.962725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1025/2056] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:52.965928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fb89d7e4f04af88c80c308d0351168', 'request_id': 'req-df9db08a-ed46-42ac-8a69-324d67359c39'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:52.966966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.978898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63664748-801b-43f1-8047-a5a134a90d92 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.989144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] The token cache is being invalidate because project e0fb89d7e4f04af88c80c308d0351168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:30:52.989466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:52.990140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-df9db08a-ed46-42ac-8a69-324d67359c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:30:52.992307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1032/2057] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:30:52 2022] DELETE /identity/v3/projects/e0fb89d7e4f04af88c80c308d0351168 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:52.997851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129e6cc-251b-45d8-ac88-3e4867ccec59 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.998375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129e6cc-251b-45d8-ac88-3e4867ccec59 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.998753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129e6cc-251b-45d8-ac88-3e4867ccec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.034512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a129e6cc-251b-45d8-ac88-3e4867ccec59 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:53.035875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a129e6cc-251b-45d8-ac88-3e4867ccec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:53.066119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.067164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.067575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.067960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.068734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.070698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.088306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1026/2058] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:53.096590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.100628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:53.124239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383a793-068a-46b6-9b19-89943f14327e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.129160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.129849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.130126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.130400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] PATH_INFO: `/v3/projects/1fc250b6d3c14e7cb79f6d47de83bd6f/users/d78210379a78451e82d4f28f74b1610b/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.146212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1033/2059] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:53.152414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc250b6d3c14e7cb79f6d47de83bd6f, user_id=d78210379a78451e82d4f28f74b1610b, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.156976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096f5a-7bd5-4934-bed1-19a43c7c4d63 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.157130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096f5a-7bd5-4934-bed1-19a43c7c4d63 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.157507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096f5a-7bd5-4934-bed1-19a43c7c4d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.158227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.189638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f8096f5a-7bd5-4934-bed1-19a43c7c4d63 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:53.192276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f8096f5a-7bd5-4934-bed1-19a43c7c4d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:53.192469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1027/2060] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:53 2022] PUT /identity/v3/projects/1fc250b6d3c14e7cb79f6d47de83bd6f/users/d78210379a78451e82d4f28f74b1610b/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:53.195963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.290485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263fa74-e4f0-4279-be46-8f70cf4ff691 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.297978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.298605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.298881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.299197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.299972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.302014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.330491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1028/2061] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:53.335898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1034/2062] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:53.336088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.339479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096f5a-7bd5-4934-bed1-19a43c7c4d63 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.349490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dda53-303a-45aa-a453-26d54b370dbe admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.358277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107e6ec-b5bc-4970-97dc-4beca03b3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.359119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e6ec-b5bc-4970-97dc-4beca03b3be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.360149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e6ec-b5bc-4970-97dc-4beca03b3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.360478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e6ec-b5bc-4970-97dc-4beca03b3be9 admin admin] PATH_INFO: `/v3/projects/1fc250b6d3c14e7cb79f6d47de83bd6f/users/d78210379a78451e82d4f28f74b1610b/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.362865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096f5a-7bd5-4934-bed1-19a43c7c4d63 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.363011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107e6ec-b5bc-4970-97dc-4beca03b3be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc250b6d3c14e7cb79f6d47de83bd6f, user_id=d78210379a78451e82d4f28f74b1610b, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.366402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107e6ec-b5bc-4970-97dc-4beca03b3be9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.391142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.392288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.393569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.393888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.396167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:53.396569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.398221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.412975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1029/2063] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:53 2022] PUT /identity/v3/projects/1fc250b6d3c14e7cb79f6d47de83bd6f/users/d78210379a78451e82d4f28f74b1610b/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:53.415028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.415377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.415745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.431821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1035/2064] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:53.437714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.446475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.459684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1040310-039c-44e9-8aba-31b1c6738a95 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.461415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] MFA Rules not processed for user `d78210379a78451e82d4f28f74b1610b`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:53.462950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:53.559083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.560336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.561327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.561775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.562741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.565791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.588939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.596066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1030/2065] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:53.609020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.610717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1036/2066] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:53 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:53.614668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:53.616165 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.692622 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4dd6e-9ba6-4a94-9810-82aaca39f559 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.695211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db871d17-e1e9-45e1-9a7f-5e36219df243 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.702573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.704004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.704504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.704919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.705760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.708122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.743257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1037/2067] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:53 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:53.752282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.767678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c697566-356c-448d-9d48-38613d96d7d0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.777221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.777451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59901710-b9ef-4a22-acc2-67a483d77fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.778180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.778384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59901710-b9ef-4a22-acc2-67a483d77fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.778568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.779058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59901710-b9ef-4a22-acc2-67a483d77fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.779473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59901710-b9ef-4a22-acc2-67a483d77fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.779666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.780515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.782273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.782439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-59901710-b9ef-4a22-acc2-67a483d77fe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:53.800992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1038/2068] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:53.802032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.818539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa5946-2781-4b59-a31a-4e4d3bb14dba admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.827085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.828408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.828806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.829383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.830405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.832258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.850287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1039/2069] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:53.851258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.863067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bb7f3-e5cb-4518-875f-bb357db9b26b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.869188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.869934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.870284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.870637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] PATH_INFO: `/v3/projects/3400d35c9c7e406089d68d83c52f0d0c/users/c0f41b58218e42f29e7a619f022e6693/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.882178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59901710-b9ef-4a22-acc2-67a483d77fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.885287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59901710-b9ef-4a22-acc2-67a483d77fe5 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.888074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3400d35c9c7e406089d68d83c52f0d0c, user_id=c0f41b58218e42f29e7a619f022e6693, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.891187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.900287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1031/2070] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:30:53.921651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1040/2071] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:53 2022] PUT /identity/v3/projects/3400d35c9c7e406089d68d83c52f0d0c/users/c0f41b58218e42f29e7a619f022e6693/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:53.923332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4aa63-fc7a-47e3-9f25-60a1063c68df None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.923647 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4aa63-fc7a-47e3-9f25-60a1063c68df None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.924212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4aa63-fc7a-47e3-9f25-60a1063c68df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.936166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.951679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4bd4aa63-fc7a-47e3-9f25-60a1063c68df None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:53.953075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4bd4aa63-fc7a-47e3-9f25-60a1063c68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:54.048041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1032/2072] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:54.058833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:54.061203 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:54.128841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c33af-072a-49bb-b032-2b637a7e1af2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:54.133560 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:54.134831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.135582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.136042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.151192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:54.153051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:54.169411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1041/2073] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:55.944325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f31cd-eff9-4c44-b821-0e37ac80d7a5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.945292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f31cd-eff9-4c44-b821-0e37ac80d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.945718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f31cd-eff9-4c44-b821-0e37ac80d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.010886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f27f31cd-eff9-4c44-b821-0e37ac80d7a5 None None] MFA Rules not processed for user `c0f41b58218e42f29e7a619f022e6693`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:56.012182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f27f31cd-eff9-4c44-b821-0e37ac80d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:56.196823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1033/2074] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:56.211042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.212751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:56.363163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:56.395069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4cae8-0d0c-43a6-acea-aebd063eccf4 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:56.409397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757d59b-ba70-4803-a5a3-52e0576efa7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:56.410198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d59b-ba70-4803-a5a3-52e0576efa7e service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.410481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d59b-ba70-4803-a5a3-52e0576efa7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.411408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757d59b-ba70-4803-a5a3-52e0576efa7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.435815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757d59b-ba70-4803-a5a3-52e0576efa7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.437784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757d59b-ba70-4803-a5a3-52e0576efa7e service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.462816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1042/2075] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:30:58.121328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.121910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.121910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.146304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] MFA Rules not processed for user `c0f41b58218e42f29e7a619f022e6693`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:58.147895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:58.161322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1034/2076] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:30:58.461347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941589-6e84-4ace-8412-567c07b991e9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.462567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941589-6e84-4ace-8412-567c07b991e9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.463322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2941589-6e84-4ace-8412-567c07b991e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.515484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a2941589-6e84-4ace-8412-567c07b991e9 None None] MFA Rules not processed for user `c7608d3fd5764366ac94f1f21784b636`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:58.517018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a2941589-6e84-4ace-8412-567c07b991e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:58.604719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1043/2077] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:30:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:30:58.609159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.610644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:58.624516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe57fb-5b21-4558-b3a5-82cb21d0ec8b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:58.629650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:58.630747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.631237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.631816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.633159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:58.635275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.666722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1035/2078] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:30:58 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:30:58.670520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2941589-6e84-4ace-8412-567c07b991e9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.688785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2941589-6e84-4ace-8412-567c07b991e9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:58.831278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:58.832501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.832785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.833107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.833777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:58.841098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.895385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1044/2079] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:30:58 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:58.897377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.912344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db277e4c-3295-4e8d-a920-de891be3063d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:58.918314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:58.919264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.919424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.920696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.920696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:58.922974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.984129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1036/2080] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:30:58.989456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:59.010265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a52c50-7401-415e-b1c8-17fb7cdc01ad admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.025294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.026464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.026691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.027184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] PATH_INFO: `/v3/projects/a063c6a70fc94b01b97f1e0e10e13f75/users/ed76a43111c94798960bac3c763572e0/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.081492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a063c6a70fc94b01b97f1e0e10e13f75, user_id=ed76a43111c94798960bac3c763572e0, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.084519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.115337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1045/2081] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:58 2022] PUT /identity/v3/projects/a063c6a70fc94b01b97f1e0e10e13f75/users/ed76a43111c94798960bac3c763572e0/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:59.117032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:59.134696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50cf88-f2d7-4a3a-a544-45140edaebc9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.296218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:59.309431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.310399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.310904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.311456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.314197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.316459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.334295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1037/2082] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:30:59.338027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:59.350808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71f9ab-11f2-455c-9824-dd39ba1f7863 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.388722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddd50f-7051-4d10-901c-5bb6ca4afe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.389740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd50f-7051-4d10-901c-5bb6ca4afe5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.390167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd50f-7051-4d10-901c-5bb6ca4afe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.391718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddd50f-7051-4d10-901c-5bb6ca4afe5c admin admin] PATH_INFO: `/v3/projects/a063c6a70fc94b01b97f1e0e10e13f75/users/ed76a43111c94798960bac3c763572e0/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.394082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd50f-7051-4d10-901c-5bb6ca4afe5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a063c6a70fc94b01b97f1e0e10e13f75, user_id=ed76a43111c94798960bac3c763572e0, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.413691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddd50f-7051-4d10-901c-5bb6ca4afe5c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.456667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1046/2083] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:30:59 2022] PUT /identity/v3/projects/a063c6a70fc94b01b97f1e0e10e13f75/users/ed76a43111c94798960bac3c763572e0/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:00.476899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:00.616092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d47f1-f32f-4be4-9b26-1fd4de84a976 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:00.809750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385cf9-8cce-4b4f-963e-2bdb59e869dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:00.810360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385cf9-8cce-4b4f-963e-2bdb59e869dc service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:00.810636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385cf9-8cce-4b4f-963e-2bdb59e869dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:00.810903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385cf9-8cce-4b4f-963e-2bdb59e869dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:00.979095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e385cf9-8cce-4b4f-963e-2bdb59e869dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:00.980626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e385cf9-8cce-4b4f-963e-2bdb59e869dc service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.006426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1038/2084] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:31:01.161503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99412-fc61-4cc7-8f77-a3b0a7b80622 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.162147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99412-fc61-4cc7-8f77-a3b0a7b80622 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.162762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e99412-fc61-4cc7-8f77-a3b0a7b80622 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.164887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1047/2085] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:31:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:01.238524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.238801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.239071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.282059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:01.283783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:01.398020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99412-fc61-4cc7-8f77-a3b0a7b80622 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.401519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-97e99412-fc61-4cc7-8f77-a3b0a7b80622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:01.440008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:01.483255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1039/2086] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:31:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:01.507411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:01.563925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.565199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:01.600788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbecd60-7e92-4748-a9ca-616e712ef979 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.619086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.623365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e99412-fc61-4cc7-8f77-a3b0a7b80622 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.624073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.625124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.625664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.633701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.636924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.637217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.637883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] PATH_INFO: `/v3/users/999a1f186ece4eabb99d7d6684469973` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.641571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999a1f186ece4eabb99d7d6684469973)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.642695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.644955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.649236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.677261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1040/2087] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:01.770671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999a1f186ece4eabb99d7d6684469973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:01.790455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999a1f186ece4eabb99d7d6684469973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:01.791287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999a1f186ece4eabb99d7d6684469973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:01.806563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999a1f186ece4eabb99d7d6684469973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:01.838674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ab86a58a-0441-47a8-8668-4b0347c38471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999a1f186ece4eabb99d7d6684469973'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:01.854976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1048/2088] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:01 2022] DELETE /identity/v3/users/999a1f186ece4eabb99d7d6684469973 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:02.349734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:02.367764 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f6c1c-c6ce-4ea0-baa7-d4b61de9e8fc service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:02.531589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:02.532401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.532778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.533180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] PATH_INFO: `/v3/projects/9b57407aaebb4cc785b7c7834e95924e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.535052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b57407aaebb4cc785b7c7834e95924e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:02.541472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:02.646973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b57407aaebb4cc785b7c7834e95924e', 'request_id': 'req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:02.654661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b57407aaebb4cc785b7c7834e95924e', 'request_id': 'req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:02.662509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b57407aaebb4cc785b7c7834e95924e', 'request_id': 'req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:02.691102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] The token cache is being invalidate because project 9b57407aaebb4cc785b7c7834e95924e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:02.691424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:02.693461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f3902a4e-3eee-4c1b-bc61-f07f0d31d5ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:02.699750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1041/2089] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:02 2022] DELETE /identity/v3/projects/9b57407aaebb4cc785b7c7834e95924e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:02.701403 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d68f-1161-44b1-8543-adb70949b2f7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.702205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d68f-1161-44b1-8543-adb70949b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.704852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d68f-1161-44b1-8543-adb70949b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.739891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-efa7d68f-1161-44b1-8543-adb70949b2f7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:02.741320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-efa7d68f-1161-44b1-8543-adb70949b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:02.962714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361fe9-1658-4a78-bf65-8665bc7a4ab4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.963131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361fe9-1658-4a78-bf65-8665bc7a4ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.964447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38361fe9-1658-4a78-bf65-8665bc7a4ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.972912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1049/2090] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:31:03.000737 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-38361fe9-1658-4a78-bf65-8665bc7a4ab4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:03.005749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-38361fe9-1658-4a78-bf65-8665bc7a4ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:03.028156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d68f-1161-44b1-8543-adb70949b2f7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.037611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1042/2091] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:03.045703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d68f-1161-44b1-8543-adb70949b2f7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.062962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.063763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.064135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.064495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.066057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:03.070497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.073075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.104547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1050/2092] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:03.109541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361fe9-1658-4a78-bf65-8665bc7a4ab4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.123503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38361fe9-1658-4a78-bf65-8665bc7a4ab4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.136150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.136953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.137340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.137713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.138473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.144659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.215814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.227986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1043/2093] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:03 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:03.232655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085600b-3c8b-4e62-9ad3-a65c09ad9823 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.332679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:03.427620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.428836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.429268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.430140 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.432689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.440125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.490457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1051/2094] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:03 2022] POST /identity/v3/users => generated 282 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:03.491109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.510527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea474476-647a-4d98-94a3-878aa6680319 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.533891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.536368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.537137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.538397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.539479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.542333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.558203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1044/2095] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:03.563043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.587133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892eaf-913f-4c76-bbe8-9fd827d33843 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.595889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab17ba-cbec-47e9-a72c-1fb3dbd5f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.596784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab17ba-cbec-47e9-a72c-1fb3dbd5f823 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.597247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab17ba-cbec-47e9-a72c-1fb3dbd5f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.597721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab17ba-cbec-47e9-a72c-1fb3dbd5f823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.598582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab17ba-cbec-47e9-a72c-1fb3dbd5f823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.600496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab17ba-cbec-47e9-a72c-1fb3dbd5f823 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.626163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1052/2096] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:03.627935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.639631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8f3b-6805-404f-aef8-2a91820cbbfd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.660094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.661608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.661982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.664454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] PATH_INFO: `/v3/projects/d5a6ebc7b78c42ca84caf127c0add8ff/users/99619e6064ac44a6a86b3c57bd4e6b92/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.695600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a6ebc7b78c42ca84caf127c0add8ff, user_id=99619e6064ac44a6a86b3c57bd4e6b92, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.698347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.729567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1045/2097] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:03 2022] PUT /identity/v3/projects/d5a6ebc7b78c42ca84caf127c0add8ff/users/99619e6064ac44a6a86b3c57bd4e6b92/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:03.740812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f817a8-ba1a-433b-bbdf-806ceb4280f2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.741761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f817a8-ba1a-433b-bbdf-806ceb4280f2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.742244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f817a8-ba1a-433b-bbdf-806ceb4280f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.798693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b4f817a8-ba1a-433b-bbdf-806ceb4280f2 None None] MFA Rules not processed for user `99619e6064ac44a6a86b3c57bd4e6b92`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:03.800806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b4f817a8-ba1a-433b-bbdf-806ceb4280f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:03.906250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1053/2098] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:03.910696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.920752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:03.996651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655db16-a7e9-438c-813d-969337211a76 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.002778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.003490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.003867 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.004427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.005089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.007054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.057333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1046/2099] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:03 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:04.061133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f817a8-ba1a-433b-bbdf-806ceb4280f2 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.073833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f817a8-ba1a-433b-bbdf-806ceb4280f2 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.170877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.171857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.172250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.172617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.173355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.178357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.226726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1054/2100] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:04 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:04.230675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.248708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb009f-58c9-4f29-98e9-d3df1582c9d6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.267373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.270499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.272009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.272362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.274458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.277438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.334643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1047/2101] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:04.338837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.354262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc9f79-f6a9-4a47-b92c-257a1dc4d26c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.368539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.369233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.369572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.369852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] PATH_INFO: `/v3/projects/7b5bbb50de7346cbbfbcdb912cb286c4/users/42be0160c3854faba93397f238d61b88/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.410544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5bbb50de7346cbbfbcdb912cb286c4, user_id=42be0160c3854faba93397f238d61b88, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.413463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.451699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1055/2102] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:04 2022] PUT /identity/v3/projects/7b5bbb50de7346cbbfbcdb912cb286c4/users/42be0160c3854faba93397f238d61b88/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:04.455399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.470772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886f67a-567e-4dae-832a-8166c13c89bd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.568232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae4611-ed7d-4fbd-8883-fb03f7b3a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.569695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4611-ed7d-4fbd-8883-fb03f7b3a14f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.570207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4611-ed7d-4fbd-8883-fb03f7b3a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.570623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae4611-ed7d-4fbd-8883-fb03f7b3a14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.571410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae4611-ed7d-4fbd-8883-fb03f7b3a14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.573415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae4611-ed7d-4fbd-8883-fb03f7b3a14f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.587730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1048/2103] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:04.592390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.646803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01c2c0-1945-404c-aad0-dbb2b162a2b1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.660120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.660947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.661331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.661703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] PATH_INFO: `/v3/projects/7b5bbb50de7346cbbfbcdb912cb286c4/users/42be0160c3854faba93397f238d61b88/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.675960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5bbb50de7346cbbfbcdb912cb286c4, user_id=42be0160c3854faba93397f238d61b88, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.701279 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.710539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:04.747317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1056/2104] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:04 2022] PUT /identity/v3/projects/7b5bbb50de7346cbbfbcdb912cb286c4/users/42be0160c3854faba93397f238d61b88/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:04.762504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bde0-fa78-423d-ac1c-159591cb15ca None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.763003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bde0-fa78-423d-ac1c-159591cb15ca None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.763412 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bde0-fa78-423d-ac1c-159591cb15ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.837395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a894bde0-fa78-423d-ac1c-159591cb15ca None None] MFA Rules not processed for user `42be0160c3854faba93397f238d61b88`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:04.838875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a894bde0-fa78-423d-ac1c-159591cb15ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:04.992219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1049/2105] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:05.009269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:05.011388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:05.083762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab0a5-6023-4d39-af06-55456b076e4f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.087467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa006c4-2a91-4cfd-b8a8-624cbc0b926b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:05.088160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa006c4-2a91-4cfd-b8a8-624cbc0b926b service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:05.088450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa006c4-2a91-4cfd-b8a8-624cbc0b926b service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:05.088724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa006c4-2a91-4cfd-b8a8-624cbc0b926b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:05.128764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa006c4-2a91-4cfd-b8a8-624cbc0b926b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:05.130442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa006c4-2a91-4cfd-b8a8-624cbc0b926b service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:05.159523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1057/2106] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:06.031734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894bde0-fa78-423d-ac1c-159591cb15ca None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.038752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:06.151761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a894bde0-fa78-423d-ac1c-159591cb15ca None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.157065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.158008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.158133 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.158463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] PATH_INFO: `/v3/users/99619e6064ac44a6a86b3c57bd4e6b92` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.159938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99619e6064ac44a6a86b3c57bd4e6b92)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.163444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.247639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99619e6064ac44a6a86b3c57bd4e6b92'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:06.260608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99619e6064ac44a6a86b3c57bd4e6b92'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:06.276306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99619e6064ac44a6a86b3c57bd4e6b92'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:06.277531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99619e6064ac44a6a86b3c57bd4e6b92'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:06.300036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27a84e6b-d57f-4706-8244-a93b8ab6e403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99619e6064ac44a6a86b3c57bd4e6b92'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:06.307819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1050/2107] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:06 2022] DELETE /identity/v3/users/99619e6064ac44a6a86b3c57bd4e6b92 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:06.312295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.312854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.312854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.336200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:06.337687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:06.355361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.355699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.355996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.389185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] MFA Rules not processed for user `ed76a43111c94798960bac3c763572e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:06.390770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:06.429202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1058/2108] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:06.441315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.444089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:06.474203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1051/2109] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:06.489798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.491699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:06.505631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:06.523586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e6216-b538-4353-a95a-78a83bb7c395 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.530052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.530845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.531306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.531829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.548025 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.550044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.576200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1059/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:31:06.615422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18528151-cfb8-4dbc-bd46-138e80ece977 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.628697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.630354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.630902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.631653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.634476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:06.717440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.719442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.735291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1052/2111] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:31:06.894368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.897455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:06.923275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5dd3a-3476-4082-85c2-30bf49fcec8e service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.926180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.927756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:06.930422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.931079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.931353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.931661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] PATH_INFO: `/v3/projects/d5a6ebc7b78c42ca84caf127c0add8ff` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.932876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a6ebc7b78c42ca84caf127c0add8ff)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.934897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.955807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67430c-11b1-471b-8be1-a866219954c1 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.970757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.970757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.971995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.972444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] PATH_INFO: `/v3/users/a747fb1ee5af4e2d98aed4c75030a11d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.974476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a747fb1ee5af4e2d98aed4c75030a11d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.978739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.010997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.026409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a6ebc7b78c42ca84caf127c0add8ff', 'request_id': 'req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.041365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a6ebc7b78c42ca84caf127c0add8ff', 'request_id': 'req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.081049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a6ebc7b78c42ca84caf127c0add8ff', 'request_id': 'req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.094484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a747fb1ee5af4e2d98aed4c75030a11d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.104248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] The token cache is being invalidate because project d5a6ebc7b78c42ca84caf127c0add8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:07.104572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.105342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.107164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1060/2112] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:06 2022] DELETE /identity/v3/projects/d5a6ebc7b78c42ca84caf127c0add8ff => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:07.111397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.112624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:07.130548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a747fb1ee5af4e2d98aed4c75030a11d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.163434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a747fb1ee5af4e2d98aed4c75030a11d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.165726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a747fb1ee5af4e2d98aed4c75030a11d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.176414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-6f225430-2166-40d4-af40-e07fd9a71025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a747fb1ee5af4e2d98aed4c75030a11d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.188730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1053/2113] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:06 2022] DELETE /identity/v3/users/a747fb1ee5af4e2d98aed4c75030a11d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:07.191269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.191575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.191888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.210435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986fb4a-1ee6-485e-8edc-ce3ea1d0088b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.221587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:07.222931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:07.235364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.331693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.332475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.332925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.333261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] PATH_INFO: `/v3/users/42be0160c3854faba93397f238d61b88` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.334590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=42be0160c3854faba93397f238d61b88)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.337271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.351122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1054/2114] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:07.370013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.370013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:07.435716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42be0160c3854faba93397f238d61b88'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.449238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42be0160c3854faba93397f238d61b88'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.450659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42be0160c3854faba93397f238d61b88'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.459147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42be0160c3854faba93397f238d61b88'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.460265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d79b58-9042-46f4-9467-710d6f8d3d39 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.465966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.466589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.467975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.468142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.469200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.471599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:07.475511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42be0160c3854faba93397f238d61b88'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:07.488037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.490112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1061/2115] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:07 2022] DELETE /identity/v3/users/42be0160c3854faba93397f238d61b88 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:07.497443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.511102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1055/2116] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:31:07.883937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.885675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:07.979671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645fc29-120a-4568-8e31-a1ed76da9a8b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.984982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.985665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.985940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.986210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] PATH_INFO: `/v3/projects/7b5bbb50de7346cbbfbcdb912cb286c4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.987808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5bbb50de7346cbbfbcdb912cb286c4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.990331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.070332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5bbb50de7346cbbfbcdb912cb286c4', 'request_id': 'req-4785ebdf-e3f2-49da-a635-5d388cf103ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.099424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.102624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.120555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232546a-42eb-4986-8630-7522815e03f5 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.123721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5bbb50de7346cbbfbcdb912cb286c4', 'request_id': 'req-4785ebdf-e3f2-49da-a635-5d388cf103ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.133218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5bbb50de7346cbbfbcdb912cb286c4', 'request_id': 'req-4785ebdf-e3f2-49da-a635-5d388cf103ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.157295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] The token cache is being invalidate because project 7b5bbb50de7346cbbfbcdb912cb286c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:08.157595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.158309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4785ebdf-e3f2-49da-a635-5d388cf103ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.163537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1062/2117] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:07 2022] DELETE /identity/v3/projects/7b5bbb50de7346cbbfbcdb912cb286c4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:08.165325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09331f-b540-49d5-99db-6fbd3fd5d4f7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.165506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09331f-b540-49d5-99db-6fbd3fd5d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.165874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09331f-b540-49d5-99db-6fbd3fd5d4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.202394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ec09331f-b540-49d5-99db-6fbd3fd5d4f7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:08.211333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ec09331f-b540-49d5-99db-6fbd3fd5d4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.228700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.229465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.229784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.230074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] PATH_INFO: `/v3/projects/62b639d257984e9994f5b2d330758413` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.232396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b639d257984e9994f5b2d330758413)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.235016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.288845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1063/2118] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:31:08.296697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de13662-5c02-4583-a8c1-58804b2e7d90 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.296977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de13662-5c02-4583-a8c1-58804b2e7d90 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.297246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de13662-5c02-4583-a8c1-58804b2e7d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.305500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b639d257984e9994f5b2d330758413', 'request_id': 'req-c5f109c6-17fa-4144-a336-40de880fd8c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.312594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b639d257984e9994f5b2d330758413', 'request_id': 'req-c5f109c6-17fa-4144-a336-40de880fd8c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.314558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.319494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b639d257984e9994f5b2d330758413', 'request_id': 'req-c5f109c6-17fa-4144-a336-40de880fd8c0'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.328840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8de13662-5c02-4583-a8c1-58804b2e7d90 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:08.330259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8de13662-5c02-4583-a8c1-58804b2e7d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.340829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] The token cache is being invalidate because project 62b639d257984e9994f5b2d330758413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:08.341680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.342507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.345272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.346528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1056/2119] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:08 2022] DELETE /identity/v3/projects/62b639d257984e9994f5b2d330758413 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:08.350224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.351753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.425338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1064/2120] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:08.429918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de13662-5c02-4583-a8c1-58804b2e7d90 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.445491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de13662-5c02-4583-a8c1-58804b2e7d90 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.448995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f109c6-17fa-4144-a336-40de880fd8c0 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.454811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.456055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.456665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.456875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.457532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.457766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.458182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.458503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] PATH_INFO: `/v3/users/d78210379a78451e82d4f28f74b1610b` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.458615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:08.458892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.459762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78210379a78451e82d4f28f74b1610b)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.460606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.461910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.475703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1065/2121] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:08.480105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.494183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcade18-a9af-4343-aa3e-bbc5644d6036 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.500759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.501974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.502296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.502664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.503315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.505765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.541217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1066/2122] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:08.545671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.547960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78210379a78451e82d4f28f74b1610b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.564680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78210379a78451e82d4f28f74b1610b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.586256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78210379a78451e82d4f28f74b1610b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.587575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78210379a78451e82d4f28f74b1610b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.595498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5d310f71-6fa4-46e2-91dd-a4bd40278eaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78210379a78451e82d4f28f74b1610b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:08.602662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1057/2123] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:08 2022] DELETE /identity/v3/users/d78210379a78451e82d4f28f74b1610b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:08.604127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.604403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.604677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.621909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcc00e-c669-4c33-bd01-4c482fe1b20c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.632982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] MFA Rules not processed for user `c7608d3fd5764366ac94f1f21784b636`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:08.634380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.712295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1058/2124] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:08.719523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.720248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.720529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.720889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.721542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.723864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.757585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1067/2125] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/users => generated 282 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:08.761458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.762907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.786444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f4ab7-9509-430a-92ce-95c755029081 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.790652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.791265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.791561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.791838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.792533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.794884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.812583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1059/2126] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:08.813828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.832467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bf756-1bad-4104-8e64-e0f8d13ea592 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.843865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72300a-ba47-490c-8957-18012653f01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.844835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72300a-ba47-490c-8957-18012653f01c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.845215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72300a-ba47-490c-8957-18012653f01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.845592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72300a-ba47-490c-8957-18012653f01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.846534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72300a-ba47-490c-8957-18012653f01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.848224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72300a-ba47-490c-8957-18012653f01c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.864257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1068/2127] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:08.868813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.874049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.882863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5ee79-1337-473c-a0af-44044af1eb6c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.898807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.899829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.900826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.900944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] PATH_INFO: `/v3/projects/1e4a269bfa7544c489f252f0a549738b/users/b486d07f469b47a785b9425e0880c5ad/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.935914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4a269bfa7544c489f252f0a549738b, user_id=b486d07f469b47a785b9425e0880c5ad, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.938953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.973447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1060/2128] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:08 2022] PUT /identity/v3/projects/1e4a269bfa7544c489f252f0a549738b/users/b486d07f469b47a785b9425e0880c5ad/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:08.974831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bd68b-8299-476f-8d17-d5ca5ece6de8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.975127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bd68b-8299-476f-8d17-d5ca5ece6de8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.975405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bd68b-8299-476f-8d17-d5ca5ece6de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.021031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.036638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-067bd68b-8299-476f-8d17-d5ca5ece6de8 None None] MFA Rules not processed for user `b486d07f469b47a785b9425e0880c5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:09.038426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-067bd68b-8299-476f-8d17-d5ca5ece6de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:09.211813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1069/2129] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:09.216829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.369319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c8d5-1f1e-40e0-b343-3ae3fda5e6c8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.380100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.380219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.380510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.380923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.381697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.383859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.430330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1061/2130] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:09 2022] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:09.433101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bd68b-8299-476f-8d17-d5ca5ece6de8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.447078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bd68b-8299-476f-8d17-d5ca5ece6de8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.466434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.468845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:09.561027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.561877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.562244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.562578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.563726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.566468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.566617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db39f1d-fdb1-406f-9c2e-c7e86a7906c2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.572785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.573853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.574404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.574783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] PATH_INFO: `/v3/projects/1fc250b6d3c14e7cb79f6d47de83bd6f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.576297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc250b6d3c14e7cb79f6d47de83bd6f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.579262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.603312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1070/2131] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:09 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:09.607938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.629654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58343e10-2bc9-4acd-bf09-aa0169fece24 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.643106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.644373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.644761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.645132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.645894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.648273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.660771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1071/2132] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:09.666352 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.669769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc250b6d3c14e7cb79f6d47de83bd6f', 'request_id': 'req-afe0d93d-a91c-4761-bfda-177e66ba91b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:09.680031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc250b6d3c14e7cb79f6d47de83bd6f', 'request_id': 'req-afe0d93d-a91c-4761-bfda-177e66ba91b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:09.680266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a343f-8265-4a20-ac7d-40387029fb81 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.688827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc250b6d3c14e7cb79f6d47de83bd6f', 'request_id': 'req-afe0d93d-a91c-4761-bfda-177e66ba91b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:09.693596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.712511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] The token cache is being invalidate because project 1fc250b6d3c14e7cb79f6d47de83bd6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:09.712511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:09.713203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-afe0d93d-a91c-4761-bfda-177e66ba91b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:09.720048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1062/2133] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:09 2022] DELETE /identity/v3/projects/1fc250b6d3c14e7cb79f6d47de83bd6f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:09.721485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5068f-cf82-40a5-a10e-7692b0e34020 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.722216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5068f-cf82-40a5-a10e-7692b0e34020 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.722812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5068f-cf82-40a5-a10e-7692b0e34020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.754460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f9d5068f-cf82-40a5-a10e-7692b0e34020 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:09.756117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f9d5068f-cf82-40a5-a10e-7692b0e34020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:09.771271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.772593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.773056 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.773345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] PATH_INFO: `/v3/projects/e4763e5b3c2848b888b9d506ffd5d9dc/users/2a1cd83244ee4415874a430ccc62f67f/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.790632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4763e5b3c2848b888b9d506ffd5d9dc, user_id=2a1cd83244ee4415874a430ccc62f67f, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.793669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.813579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1072/2134] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:09 2022] PUT /identity/v3/projects/e4763e5b3c2848b888b9d506ffd5d9dc/users/2a1cd83244ee4415874a430ccc62f67f/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:09.817464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.819424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:09.831002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.868979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1063/2135] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:09.941602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b43bb3-65bd-4f72-a72d-199891868c69 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.942960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b43bb3-65bd-4f72-a72d-199891868c69 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.943403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b43bb3-65bd-4f72-a72d-199891868c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.969489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-91b43bb3-65bd-4f72-a72d-199891868c69 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:09.970756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-91b43bb3-65bd-4f72-a72d-199891868c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:09.981025 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a9c0-d322-4459-8449-f32c28acdfaf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.981746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1064/2136] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:31:09.987086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b43bb3-65bd-4f72-a72d-199891868c69 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.990989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.992570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.993019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.993634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.995341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.998136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.001251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b43bb3-65bd-4f72-a72d-199891868c69 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.008382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.009025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.009813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.010159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.010943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:10.011132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.013728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.016233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1073/2137] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:10.020303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.035343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1065/2138] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:10.036372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.038039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be1d74-d7e0-442b-82f7-e40aa660090c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.045791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90add-d24a-4efa-8775-038f1ec20c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.048228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90add-d24a-4efa-8775-038f1ec20c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.048530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90add-d24a-4efa-8775-038f1ec20c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.048882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90add-d24a-4efa-8775-038f1ec20c5f admin admin] PATH_INFO: `/v3/projects/e4763e5b3c2848b888b9d506ffd5d9dc/users/2a1cd83244ee4415874a430ccc62f67f/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.049421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be4f0a-5e63-4136-adb6-f19be18eeb78 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.051158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca90add-d24a-4efa-8775-038f1ec20c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4763e5b3c2848b888b9d506ffd5d9dc, user_id=2a1cd83244ee4415874a430ccc62f67f, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.054561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.054724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca90add-d24a-4efa-8775-038f1ec20c5f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.055586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.055781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.056053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.056692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.058613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.070764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1074/2139] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:10 2022] PUT /identity/v3/projects/e4763e5b3c2848b888b9d506ffd5d9dc/users/2a1cd83244ee4415874a430ccc62f67f/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:10.081297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.081502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.081756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.096457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1066/2140] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:10 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:10.100539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.129418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] MFA Rules not processed for user `2a1cd83244ee4415874a430ccc62f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:10.131933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:10.193824 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47e5b0-52ee-4f79-8739-b55390434886 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.201137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.201820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.202201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.202549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.203607 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.205563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.228900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1075/2141] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:10.234888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1067/2142] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:10 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:10.239347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.239510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.241630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:10.251383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b016e58-6941-4aaa-8fc8-84b88fc8ff81 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.256612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.257223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.257525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.257796 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.258470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.260127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.278540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1068/2143] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:10.282835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.302204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633df69-2042-4be5-a166-a85cdbb8782b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.310221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.310876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.311888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.312055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.313139 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.315017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.330462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c0649-a0d2-41b9-af08-69af11cc1037 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.331705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1069/2144] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:10.333952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.336814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a561fe-1167-449d-b6df-2589928c9191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.337573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a561fe-1167-449d-b6df-2589928c9191 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.337844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a561fe-1167-449d-b6df-2589928c9191 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.338110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a561fe-1167-449d-b6df-2589928c9191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.346061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c14ca6-99ae-4511-bc7d-ec64f7ab7e0a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.351148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a561fe-1167-449d-b6df-2589928c9191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.351148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a561fe-1167-449d-b6df-2589928c9191 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.354293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.354973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.355246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.355518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] PATH_INFO: `/v3/projects/ee36254418da48fd95d9d163068934b0/users/09934c1fdc1b4ee5bfbda0618f2fb1b5/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.361914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1076/2145] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:10.371346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee36254418da48fd95d9d163068934b0, user_id=09934c1fdc1b4ee5bfbda0618f2fb1b5, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.374242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.378217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.392326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1070/2146] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:10 2022] PUT /identity/v3/projects/ee36254418da48fd95d9d163068934b0/users/09934c1fdc1b4ee5bfbda0618f2fb1b5/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:10.403833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ffca-ea6a-40d3-be6f-215a8da62e75 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.404322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ffca-ea6a-40d3-be6f-215a8da62e75 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.404595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ffca-ea6a-40d3-be6f-215a8da62e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.451636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.458638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d015ffca-ea6a-40d3-be6f-215a8da62e75 None None] MFA Rules not processed for user `09934c1fdc1b4ee5bfbda0618f2fb1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:10.460093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d015ffca-ea6a-40d3-be6f-215a8da62e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:10.469385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.555291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468aa75-dc3e-406c-842d-41583d200485 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.559929 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.560661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.561074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.561377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.563896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:10.566003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1077/2147] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:10.571572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015ffca-ea6a-40d3-be6f-215a8da62e75 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.639795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.641589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.651118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015ffca-ea6a-40d3-be6f-215a8da62e75 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.654739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1071/2148] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:10.661812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.662544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.662921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.663343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.664120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.666241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.702583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1078/2149] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:10 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:10.706388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.721292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba3fe1-a74b-44c8-a91c-6be8ebb4aa91 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.867602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.868597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.868933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.869217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.870302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.872472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.923345 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1072/2150] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:10 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:10.927901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.943190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9509c1-c2be-44a1-8444-8127fb625e9b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.949432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.949971 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.950379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.950651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.951424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.953562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.968832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1079/2151] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:10.973207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.989339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6833132-839f-4d4b-a26d-11f9ed106937 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.994808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.995714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.996089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.996458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] PATH_INFO: `/v3/projects/2469e2469d8b42e19b3c239039b77f0f/users/952918ba19204e42aa01dac1475bb1e8/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.016269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2469e2469d8b42e19b3c239039b77f0f, user_id=952918ba19204e42aa01dac1475bb1e8, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.019951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:11.050805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1073/2152] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:10 2022] PUT /identity/v3/projects/2469e2469d8b42e19b3c239039b77f0f/users/952918ba19204e42aa01dac1475bb1e8/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:11.054243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:11.066450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729514b-fe95-4693-8f3a-9c9976a946ba admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:11.137147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c2748-fc36-4257-ad73-84f82bd01b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:11.137765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2748-fc36-4257-ad73-84f82bd01b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.138039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2748-fc36-4257-ad73-84f82bd01b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.138308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c2748-fc36-4257-ad73-84f82bd01b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.138951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2748-fc36-4257-ad73-84f82bd01b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.141160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c2748-fc36-4257-ad73-84f82bd01b4b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:11.154616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1080/2153] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:11.160473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:11.171334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36092ecf-502c-4a9c-80c2-8dadaad296d4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:11.176438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:11.177114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.177386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.177667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] PATH_INFO: `/v3/projects/2469e2469d8b42e19b3c239039b77f0f/users/952918ba19204e42aa01dac1475bb1e8/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.180111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2469e2469d8b42e19b3c239039b77f0f, user_id=952918ba19204e42aa01dac1475bb1e8, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.186027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:11.211384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1074/2154] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:11 2022] PUT /identity/v3/projects/2469e2469d8b42e19b3c239039b77f0f/users/952918ba19204e42aa01dac1475bb1e8/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:11.213117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91614e9-9ab6-458e-b965-7a21376f14d4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.213417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91614e9-9ab6-458e-b965-7a21376f14d4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.213696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91614e9-9ab6-458e-b965-7a21376f14d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.247423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:11.252678 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f91614e9-9ab6-458e-b965-7a21376f14d4 None None] MFA Rules not processed for user `952918ba19204e42aa01dac1475bb1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:11.254551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f91614e9-9ab6-458e-b965-7a21376f14d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:11.338168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1081/2155] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:31:11.349884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:11.354630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:11.413144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff10e89-5d25-4bf5-9dcb-520ad3c75fd9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:11.417273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfccd9-8fe4-432b-b3bc-be30ae87e40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:11.417883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfccd9-8fe4-432b-b3bc-be30ae87e40f service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.418155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfccd9-8fe4-432b-b3bc-be30ae87e40f service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.418427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfccd9-8fe4-432b-b3bc-be30ae87e40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.483025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfccd9-8fe4-432b-b3bc-be30ae87e40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.484738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfccd9-8fe4-432b-b3bc-be30ae87e40f service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:11.495697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1075/2156] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:13.563776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91614e9-9ab6-458e-b965-7a21376f14d4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.629957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91614e9-9ab6-458e-b965-7a21376f14d4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.634489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.635124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.635401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.635710 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] PATH_INFO: `/v3/users/b486d07f469b47a785b9425e0880c5ad` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.636835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b486d07f469b47a785b9425e0880c5ad)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.638773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.688529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b486d07f469b47a785b9425e0880c5ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:13.697300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b486d07f469b47a785b9425e0880c5ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:13.697992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b486d07f469b47a785b9425e0880c5ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:13.707810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b486d07f469b47a785b9425e0880c5ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:13.720188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b486d07f469b47a785b9425e0880c5ad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:13.726268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1082/2157] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:13 2022] DELETE /identity/v3/users/b486d07f469b47a785b9425e0880c5ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:13.730772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.731265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.731367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.750718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:13.752372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:13.815108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1076/2158] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:13.825481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.827963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:13.850495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:13.895573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698eac28-bb3c-4a84-9da4-d3b5f47535c3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.899826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.900455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.900736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.901006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.910469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.912028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.921634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1083/2159] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:14.124344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.126069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:14.139220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cda15-ff1b-49fd-bd27-64292cc65e38 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.145010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.145801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.146078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.146317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] PATH_INFO: `/v3/users/09934c1fdc1b4ee5bfbda0618f2fb1b5` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.147572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=09934c1fdc1b4ee5bfbda0618f2fb1b5)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.149521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.201108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09934c1fdc1b4ee5bfbda0618f2fb1b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.202883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.207135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:14.210973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.216599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09934c1fdc1b4ee5bfbda0618f2fb1b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.222463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927d96c-6e3b-4419-9ba1-ed64bc6a1b40 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.234312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09934c1fdc1b4ee5bfbda0618f2fb1b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.235241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09934c1fdc1b4ee5bfbda0618f2fb1b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.235381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.236010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.236295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.236556 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] PATH_INFO: `/v3/projects/1e4a269bfa7544c489f252f0a549738b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.237721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4a269bfa7544c489f252f0a549738b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.239673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.243238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-66822cf7-bdb8-42a3-970a-49a7fad4b15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09934c1fdc1b4ee5bfbda0618f2fb1b5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.252812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1077/2160] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:14 2022] DELETE /identity/v3/users/09934c1fdc1b4ee5bfbda0618f2fb1b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:14.255054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.255447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.255832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.275864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:14.277190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:14.331635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4a269bfa7544c489f252f0a549738b', 'request_id': 'req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.341591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4a269bfa7544c489f252f0a549738b', 'request_id': 'req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.346340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1078/2161] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:31:14.354963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4a269bfa7544c489f252f0a549738b', 'request_id': 'req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.357293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.358925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:14.367516 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] The token cache is being invalidate because project 1e4a269bfa7544c489f252f0a549738b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:14.367917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.368637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.373689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1084/2162] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:14 2022] DELETE /identity/v3/projects/1e4a269bfa7544c489f252f0a549738b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:14.374516 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.375989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:14.427110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb169fda-819f-489e-a08a-fa3d64f1f121 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.471090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbd9ab-6063-42d6-9fb5-6ae95a46dc23 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.476051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.476775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.477119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.477460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] PATH_INFO: `/v3/users/2a1cd83244ee4415874a430ccc62f67f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.478630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1cd83244ee4415874a430ccc62f67f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.480602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.483988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.484720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.485000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.485279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.487840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:14.499756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.501271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.511567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1079/2163] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:31:14.530974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.533485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1cd83244ee4415874a430ccc62f67f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.545706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1cd83244ee4415874a430ccc62f67f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.546450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1cd83244ee4415874a430ccc62f67f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.556105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1cd83244ee4415874a430ccc62f67f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.568893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1cd83244ee4415874a430ccc62f67f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:14.576128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1085/2164] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:14 2022] DELETE /identity/v3/users/2a1cd83244ee4415874a430ccc62f67f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:14.957183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.959158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:14.974285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ed542-6810-4d68-afb6-489eeef1b1c8 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.996431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.998335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.006403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.047565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.048377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.048726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.049080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] PATH_INFO: `/v3/projects/ee36254418da48fd95d9d163068934b0` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.050232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee36254418da48fd95d9d163068934b0)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.052928 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.073896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d3c17-f164-4c2e-b74d-d0ccc742bbd9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.079641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.080317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.080624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.080902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] PATH_INFO: `/v3/projects/e4763e5b3c2848b888b9d506ffd5d9dc` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.082191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4763e5b3c2848b888b9d506ffd5d9dc)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.085939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.116125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee36254418da48fd95d9d163068934b0', 'request_id': 'req-c80a2399-eed9-493b-862a-e43b645bf52e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.122034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee36254418da48fd95d9d163068934b0', 'request_id': 'req-c80a2399-eed9-493b-862a-e43b645bf52e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.129258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee36254418da48fd95d9d163068934b0', 'request_id': 'req-c80a2399-eed9-493b-862a-e43b645bf52e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.141682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4763e5b3c2848b888b9d506ffd5d9dc', 'request_id': 'req-7ac5f64e-aca5-4e49-af9c-66fcfe205304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.145423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] The token cache is being invalidate because project ee36254418da48fd95d9d163068934b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:15.145817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.146487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.148587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1080/2165] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:14 2022] DELETE /identity/v3/projects/ee36254418da48fd95d9d163068934b0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:15.156194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4763e5b3c2848b888b9d506ffd5d9dc', 'request_id': 'req-7ac5f64e-aca5-4e49-af9c-66fcfe205304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.161093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.163180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.163626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4763e5b3c2848b888b9d506ffd5d9dc', 'request_id': 'req-7ac5f64e-aca5-4e49-af9c-66fcfe205304'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.176134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] The token cache is being invalidate because project e4763e5b3c2848b888b9d506ffd5d9dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:15.176437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.177135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7ac5f64e-aca5-4e49-af9c-66fcfe205304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.179407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1086/2166] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:14 2022] DELETE /identity/v3/projects/e4763e5b3c2848b888b9d506ffd5d9dc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:15.184743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c084fa-b1a0-410d-9f99-c46de155b812 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.185031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c084fa-b1a0-410d-9f99-c46de155b812 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.185311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c084fa-b1a0-410d-9f99-c46de155b812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.210888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f9c084fa-b1a0-410d-9f99-c46de155b812 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:15.212260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f9c084fa-b1a0-410d-9f99-c46de155b812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.254997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a2399-eed9-493b-862a-e43b645bf52e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.269603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.290219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1087/2167] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:15.298219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2014-df2e-4687-861c-7b815ebf4af1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.298589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2014-df2e-4687-861c-7b815ebf4af1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.298936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf2014-df2e-4687-861c-7b815ebf4af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.320904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4edf2014-df2e-4687-861c-7b815ebf4af1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:15.322104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4edf2014-df2e-4687-861c-7b815ebf4af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.322247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.322798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.323083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.323353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] PATH_INFO: `/v3/users/952918ba19204e42aa01dac1475bb1e8` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.324482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952918ba19204e42aa01dac1475bb1e8)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.326772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.331362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1088/2168] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:15.335448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.335825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf2014-df2e-4687-861c-7b815ebf4af1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.345882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf2014-df2e-4687-861c-7b815ebf4af1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.350982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.351724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.352070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.352412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.353824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:15.354136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.356576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.378221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1089/2169] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:15.379133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.386126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952918ba19204e42aa01dac1475bb1e8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.389060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e541-98eb-4d15-ba6d-e37f09797676 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.395463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952918ba19204e42aa01dac1475bb1e8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.398131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.398765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.399046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.399316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.399991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.401906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.409582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952918ba19204e42aa01dac1475bb1e8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.410294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952918ba19204e42aa01dac1475bb1e8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.418579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952918ba19204e42aa01dac1475bb1e8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:15.425923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1081/2170] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:15 2022] DELETE /identity/v3/users/952918ba19204e42aa01dac1475bb1e8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:15.436549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1090/2171] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:15.444263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.445789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.533093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa09c-d7c8-4a2f-8c44-0c967a2c6817 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.596901 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.597655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.597956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.598226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.598864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.600809 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.628145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1082/2172] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:15.633830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.645265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d061b5-f991-4661-adf4-7bcd7a4a0aff admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.654144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.655041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.656035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.656624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.657598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.660404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.672207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1091/2173] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:15.676724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.692325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5849e-ac20-46eb-a01e-b8f16182169f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.697431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825d379-97a3-487c-a885-418d09acf0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.698112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825d379-97a3-487c-a885-418d09acf0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.698401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825d379-97a3-487c-a885-418d09acf0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.698678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825d379-97a3-487c-a885-418d09acf0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.699418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825d379-97a3-487c-a885-418d09acf0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.701861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825d379-97a3-487c-a885-418d09acf0e9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.723253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.723428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1083/2174] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:15.732096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc144a7-03b1-4df3-b3e7-772ea1632e48 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.737536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.738210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.738491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.738767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] PATH_INFO: `/v3/projects/52ba4d3d93fe420d902b5e1b8e6e19e0/users/f9034e1685c44ba3b32b01cf2d2add8f/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.758604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ba4d3d93fe420d902b5e1b8e6e19e0, user_id=f9034e1685c44ba3b32b01cf2d2add8f, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.762003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.784008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1092/2175] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:15 2022] PUT /identity/v3/projects/52ba4d3d93fe420d902b5e1b8e6e19e0/users/f9034e1685c44ba3b32b01cf2d2add8f/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:15.795953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec91b5-8892-4e74-94dd-2b417fa60271 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.796240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec91b5-8892-4e74-94dd-2b417fa60271 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.796521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec91b5-8892-4e74-94dd-2b417fa60271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.812320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.814838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.834046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.847792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c0ec91b5-8892-4e74-94dd-2b417fa60271 None None] MFA Rules not processed for user `f9034e1685c44ba3b32b01cf2d2add8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:15.850200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c0ec91b5-8892-4e74-94dd-2b417fa60271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.904782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162732a-7373-4861-99b4-a2d6b0dfd835 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.914595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.915250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.915691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.916031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] PATH_INFO: `/v3/projects/2469e2469d8b42e19b3c239039b77f0f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.917254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2469e2469d8b42e19b3c239039b77f0f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.919588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.939065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1084/2176] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:15.940384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec91b5-8892-4e74-94dd-2b417fa60271 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.962512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec91b5-8892-4e74-94dd-2b417fa60271 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.968653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.969650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.969933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.970315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.970972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.973451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.993510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2469e2469d8b42e19b3c239039b77f0f', 'request_id': 'req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:16.005127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2469e2469d8b42e19b3c239039b77f0f', 'request_id': 'req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:16.021882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2469e2469d8b42e19b3c239039b77f0f', 'request_id': 'req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:16.024367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1085/2177] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:16.029185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.039055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] The token cache is being invalidate because project 2469e2469d8b42e19b3c239039b77f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:16.039632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:16.040906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:16.049841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1093/2178] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:15 2022] DELETE /identity/v3/projects/2469e2469d8b42e19b3c239039b77f0f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:16.119646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3f54d-ddee-4845-8186-396eba1598d3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.128005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.129529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.129815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.130344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.131224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.134464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.179573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1086/2179] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:16 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:16.183801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.185561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:16.204894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.295005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c5d54-db90-43a1-943e-27fe4a8f05b8 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.303576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.304464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.304750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.305026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.305695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.307523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.322001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1094/2180] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:16.323260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.336235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81abad1-f9f5-478a-ba5d-375b11e42474 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.347184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.348022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.348404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.349593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] PATH_INFO: `/v3/projects/dfc10ce1fad24dcdb0450712e155223d/users/76eacf54c75a4116934f412fd8f53adf/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.368052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc10ce1fad24dcdb0450712e155223d, user_id=76eacf54c75a4116934f412fd8f53adf, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.371012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.387582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1087/2181] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:16 2022] PUT /identity/v3/projects/dfc10ce1fad24dcdb0450712e155223d/users/76eacf54c75a4116934f412fd8f53adf/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:16.391884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.401955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c1bb3-8328-4338-9a98-399fc0198b0e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.460572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08197db-327d-49e9-8bff-94330b75c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.461184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08197db-327d-49e9-8bff-94330b75c7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.461466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08197db-327d-49e9-8bff-94330b75c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.461733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08197db-327d-49e9-8bff-94330b75c7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.462375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08197db-327d-49e9-8bff-94330b75c7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.464002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08197db-327d-49e9-8bff-94330b75c7e1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.474366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1095/2182] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:16.478793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.489595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd168-4f0c-4f3d-9c82-db4ce2e5f841 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.497268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.497920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.498200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.498443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] PATH_INFO: `/v3/projects/dfc10ce1fad24dcdb0450712e155223d/users/76eacf54c75a4116934f412fd8f53adf/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.500681 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc10ce1fad24dcdb0450712e155223d, user_id=76eacf54c75a4116934f412fd8f53adf, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.503352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.514046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1088/2183] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:16 2022] PUT /identity/v3/projects/dfc10ce1fad24dcdb0450712e155223d/users/76eacf54c75a4116934f412fd8f53adf/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:16.524583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505591-cc1e-4d53-ade3-3847adaaa805 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.524871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505591-cc1e-4d53-ade3-3847adaaa805 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.525138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76505591-cc1e-4d53-ade3-3847adaaa805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.555856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-76505591-cc1e-4d53-ade3-3847adaaa805 None None] MFA Rules not processed for user `76eacf54c75a4116934f412fd8f53adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:16.557084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-76505591-cc1e-4d53-ade3-3847adaaa805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:16.638046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1096/2184] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:16.651067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.653108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:16.689645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.714961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f49d7-3760-4e21-b8dc-fffd512a1ab7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.719000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.719708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.719987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.720256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.734323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.735957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.747015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1089/2185] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:16.844647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76505591-cc1e-4d53-ade3-3847adaaa805 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.855101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76505591-cc1e-4d53-ade3-3847adaaa805 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.859217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1162844-544d-477e-a2e3-8103985c545d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.860191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162844-544d-477e-a2e3-8103985c545d service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.860435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162844-544d-477e-a2e3-8103985c545d service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.860941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1162844-544d-477e-a2e3-8103985c545d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.863815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c1162844-544d-477e-a2e3-8103985c545d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:16.888763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.935955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162844-544d-477e-a2e3-8103985c545d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.937405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1162844-544d-477e-a2e3-8103985c545d service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.948168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1097/2186] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:21.938018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.006181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399db2fb-f5e7-46b2-a2c0-c48cd467e63a service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.011401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.012086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.012405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.012643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] PATH_INFO: `/v3/users/f9034e1685c44ba3b32b01cf2d2add8f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.013957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9034e1685c44ba3b32b01cf2d2add8f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.016023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.075099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9034e1685c44ba3b32b01cf2d2add8f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.084974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9034e1685c44ba3b32b01cf2d2add8f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.099265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9034e1685c44ba3b32b01cf2d2add8f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.100243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9034e1685c44ba3b32b01cf2d2add8f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.109790 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9034e1685c44ba3b32b01cf2d2add8f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.120065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1090/2187] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:21 2022] DELETE /identity/v3/users/f9034e1685c44ba3b32b01cf2d2add8f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:22.124855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.125422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.125422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.146035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:22.147295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:22.220380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1098/2188] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:22.233733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.235413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:22.300011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b4bfc-b29a-4a03-842e-6f4aa2ec5607 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.304085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.304705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.304997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.305265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.312608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:22.314956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.316499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.327348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1091/2189] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:22.670313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.673404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:22.686966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35409-0848-44df-9be1-3bb990eae178 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.692171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.693153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.693447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.693712 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] PATH_INFO: `/v3/projects/52ba4d3d93fe420d902b5e1b8e6e19e0` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.694874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ba4d3d93fe420d902b5e1b8e6e19e0)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.696873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.768604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ba4d3d93fe420d902b5e1b8e6e19e0', 'request_id': 'req-0a7d43df-c905-4e84-ad6e-1a00111653ee'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.776769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ba4d3d93fe420d902b5e1b8e6e19e0', 'request_id': 'req-0a7d43df-c905-4e84-ad6e-1a00111653ee'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.783176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ba4d3d93fe420d902b5e1b8e6e19e0', 'request_id': 'req-0a7d43df-c905-4e84-ad6e-1a00111653ee'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.794312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] The token cache is being invalidate because project 52ba4d3d93fe420d902b5e1b8e6e19e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:22.794609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.795252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.796948 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1099/2190] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:22 2022] DELETE /identity/v3/projects/52ba4d3d93fe420d902b5e1b8e6e19e0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:22.801423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.813185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829e9e3-670c-4cbe-b11a-d6c86330f9f7 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.876953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.877635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.877913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.878180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] PATH_INFO: `/v3/users/76eacf54c75a4116934f412fd8f53adf` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.879434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] RBAC: Authorizing `identity:delete_user(user_id=76eacf54c75a4116934f412fd8f53adf)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.881537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.936219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76eacf54c75a4116934f412fd8f53adf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.947778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76eacf54c75a4116934f412fd8f53adf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.966758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76eacf54c75a4116934f412fd8f53adf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.967613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76eacf54c75a4116934f412fd8f53adf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.976304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0a98cc71-ec9c-4860-9e96-7f3c9c41b38f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76eacf54c75a4116934f412fd8f53adf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:22.982468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1092/2191] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:22 2022] DELETE /identity/v3/users/76eacf54c75a4116934f412fd8f53adf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:23.309047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.310534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:23.339376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d43df-c905-4e84-ad6e-1a00111653ee admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.397830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.414427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.415644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.416131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.416395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] PATH_INFO: `/v3/projects/dfc10ce1fad24dcdb0450712e155223d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.417666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc10ce1fad24dcdb0450712e155223d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.419608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.478942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc10ce1fad24dcdb0450712e155223d', 'request_id': 'req-d459fd89-4d84-4cfc-aa15-825248c3a5ef'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:23.488287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc10ce1fad24dcdb0450712e155223d', 'request_id': 'req-d459fd89-4d84-4cfc-aa15-825248c3a5ef'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:23.494933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc10ce1fad24dcdb0450712e155223d', 'request_id': 'req-d459fd89-4d84-4cfc-aa15-825248c3a5ef'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:23.511864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] The token cache is being invalidate because project dfc10ce1fad24dcdb0450712e155223d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:23.511864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:23.511864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d459fd89-4d84-4cfc-aa15-825248c3a5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:23.511864 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1100/2192] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:23 2022] DELETE /identity/v3/projects/dfc10ce1fad24dcdb0450712e155223d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:23.516604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5057f5-f515-4572-899f-d902fec002fe None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.516899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5057f5-f515-4572-899f-d902fec002fe None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.517220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5057f5-f515-4572-899f-d902fec002fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.539099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9e5057f5-f515-4572-899f-d902fec002fe None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:23.540362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9e5057f5-f515-4572-899f-d902fec002fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:23.606116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1093/2193] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:23.614328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2045b-2f7b-4c4f-bc67-38824ae9f355 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.614715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2045b-2f7b-4c4f-bc67-38824ae9f355 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.615018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2045b-2f7b-4c4f-bc67-38824ae9f355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.637580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-45b2045b-2f7b-4c4f-bc67-38824ae9f355 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:23.638824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-45b2045b-2f7b-4c4f-bc67-38824ae9f355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:23.647336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1101/2194] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:23.652966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5057f5-f515-4572-899f-d902fec002fe None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.664423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5057f5-f515-4572-899f-d902fec002fe None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.669637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.670587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.671893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.672168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.673166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:23.673598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.675608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.689416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1094/2195] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:23.694162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2045b-2f7b-4c4f-bc67-38824ae9f355 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.703841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2045b-2f7b-4c4f-bc67-38824ae9f355 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.709458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.710063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.710344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.710614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.711282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.713249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.747199 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1102/2196] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:23 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:23.751994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.757600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.764390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96ec3-0499-4488-b851-d617897984f2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.830323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.831264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.834424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.834424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.834424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.834753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.859143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1095/2197] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:23 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:23.863527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.874894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a92db1-a782-434d-9c4b-1a7bd43fb34d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.880282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.880935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.881217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.881487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.882139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.883892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.896644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1103/2198] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:23.900870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.911611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e9462-bf14-49d3-95b0-164ae8849038 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.916482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac126d-5a4f-4455-9dee-bcc17f8d8c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.917086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac126d-5a4f-4455-9dee-bcc17f8d8c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.917386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac126d-5a4f-4455-9dee-bcc17f8d8c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.917663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac126d-5a4f-4455-9dee-bcc17f8d8c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.918307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac126d-5a4f-4455-9dee-bcc17f8d8c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.919958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac126d-5a4f-4455-9dee-bcc17f8d8c00 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.931472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1096/2199] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:23.935711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.946700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d7b939-1b0e-496a-9090-ddef85932546 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.951676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.952391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.952788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.953059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] PATH_INFO: `/v3/projects/6395e10275fd47b5ae83b3535195623f/users/32fd9bcbcba04f3dbbeb9f6600931420/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.970783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6395e10275fd47b5ae83b3535195623f, user_id=32fd9bcbcba04f3dbbeb9f6600931420, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.974104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.990265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1104/2200] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:23 2022] PUT /identity/v3/projects/6395e10275fd47b5ae83b3535195623f/users/32fd9bcbcba04f3dbbeb9f6600931420/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:24.001971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712853c-dcc3-4003-b862-a5ab0b5119ba None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:24.002410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712853c-dcc3-4003-b862-a5ab0b5119ba None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:24.002524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712853c-dcc3-4003-b862-a5ab0b5119ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:24.031512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3712853c-dcc3-4003-b862-a5ab0b5119ba None None] MFA Rules not processed for user `32fd9bcbcba04f3dbbeb9f6600931420`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:24.032784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3712853c-dcc3-4003-b862-a5ab0b5119ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:24.111201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1097/2201] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:24.122702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:24.125513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:24.191427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ffe9-af0e-4daa-a132-402928078275 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:24.200707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f18f1-27b2-411b-9a3e-e16b77ab3cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:24.201236 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f18f1-27b2-411b-9a3e-e16b77ab3cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:24.201540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f18f1-27b2-411b-9a3e-e16b77ab3cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:24.201779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f18f1-27b2-411b-9a3e-e16b77ab3cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:24.210838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f18f1-27b2-411b-9a3e-e16b77ab3cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:24.212335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f18f1-27b2-411b-9a3e-e16b77ab3cc6 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:24.221122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1105/2202] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:28.394416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712853c-dcc3-4003-b862-a5ab0b5119ba None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:28.462294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712853c-dcc3-4003-b862-a5ab0b5119ba None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:28.467760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.468395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.468674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.468974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] PATH_INFO: `/v3/users/32fd9bcbcba04f3dbbeb9f6600931420` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.470180 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fd9bcbcba04f3dbbeb9f6600931420)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.472165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:28.487618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:28.534439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fd9bcbcba04f3dbbeb9f6600931420'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:28.548239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fd9bcbcba04f3dbbeb9f6600931420'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:28.567822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fd9bcbcba04f3dbbeb9f6600931420'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:28.568583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fd9bcbcba04f3dbbeb9f6600931420'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:28.577214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fd9bcbcba04f3dbbeb9f6600931420'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:28.583128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1098/2203] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:28 2022] DELETE /identity/v3/users/32fd9bcbcba04f3dbbeb9f6600931420 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:28.588133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.588604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.588691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.608284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:28.609523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:28.619680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:28.676469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1106/2204] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:28.690830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:28.692819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:28.764758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4aa3-4c25-4601-ba48-2eb00d33a92f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:28.768848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd77a7-2378-4cba-82a2-e4db2115a195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.769862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd77a7-2378-4cba-82a2-e4db2115a195 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.770144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd77a7-2378-4cba-82a2-e4db2115a195 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.770416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd77a7-2378-4cba-82a2-e4db2115a195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.781395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd77a7-2378-4cba-82a2-e4db2115a195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.782966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd77a7-2378-4cba-82a2-e4db2115a195 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:28.793391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1099/2205] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:29.138484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.140172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:29.152795 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb334201-0a4b-4f7c-a232-18a1b135ff16 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.158938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.159597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.159916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.160221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] PATH_INFO: `/v3/projects/6395e10275fd47b5ae83b3535195623f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.161742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6395e10275fd47b5ae83b3535195623f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.164045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.215796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6395e10275fd47b5ae83b3535195623f', 'request_id': 'req-5043d333-d55b-4754-b9c8-8aa1b9f7f140'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:29.224849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6395e10275fd47b5ae83b3535195623f', 'request_id': 'req-5043d333-d55b-4754-b9c8-8aa1b9f7f140'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:29.233807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6395e10275fd47b5ae83b3535195623f', 'request_id': 'req-5043d333-d55b-4754-b9c8-8aa1b9f7f140'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:29.245463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] The token cache is being invalidate because project 6395e10275fd47b5ae83b3535195623f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:29.245753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:29.246447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5043d333-d55b-4754-b9c8-8aa1b9f7f140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:29.248041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1107/2206] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:29 2022] DELETE /identity/v3/projects/6395e10275fd47b5ae83b3535195623f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:29.253501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5f85e-a2e6-416d-b631-4c54160cadf5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.253891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5f85e-a2e6-416d-b631-4c54160cadf5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.254279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5f85e-a2e6-416d-b631-4c54160cadf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.275594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-eac5f85e-a2e6-416d-b631-4c54160cadf5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:29.276755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eac5f85e-a2e6-416d-b631-4c54160cadf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:29.347367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1100/2207] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:29.356056 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638e81-d0c5-46c2-8395-87741f084b54 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.356344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638e81-d0c5-46c2-8395-87741f084b54 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.356612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73638e81-d0c5-46c2-8395-87741f084b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.377785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-73638e81-d0c5-46c2-8395-87741f084b54 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:29.379021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-73638e81-d0c5-46c2-8395-87741f084b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:29.387270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1108/2208] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:29.392263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5f85e-a2e6-416d-b631-4c54160cadf5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.403270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5f85e-a2e6-416d-b631-4c54160cadf5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.408224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.408837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.409115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.410392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.411071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:29.411378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.413122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.430617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1101/2209] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:29.432270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638e81-d0c5-46c2-8395-87741f084b54 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.442250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73638e81-d0c5-46c2-8395-87741f084b54 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.447069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.447720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.447994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.448265 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.448901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.450799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.483011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1109/2210] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:29 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:29.487312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.497572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d046-841c-4a70-a61a-b91716437e7b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.514776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:29.557991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.558495 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.558770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.559012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.559818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.561740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.587424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1102/2211] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:29 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:29.590340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.601244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf557385-1350-4a51-8580-ad2bfe06b8e5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.607399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.608205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.608582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.608747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.609415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.611092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.622185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1110/2212] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:29.626627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.637008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9774ed6-2553-49ab-b113-e01037c6e7be admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.642353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061d8c8-c9d0-47f0-991f-ee0482e6047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.643063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d8c8-c9d0-47f0-991f-ee0482e6047a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.643384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d8c8-c9d0-47f0-991f-ee0482e6047a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.643690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061d8c8-c9d0-47f0-991f-ee0482e6047a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.644336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061d8c8-c9d0-47f0-991f-ee0482e6047a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.645962 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061d8c8-c9d0-47f0-991f-ee0482e6047a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.657767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1103/2213] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:29.662103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.673324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0bfc6-a71f-446c-9349-4cc6f6405294 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.678717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.679372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.679679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.679968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] PATH_INFO: `/v3/projects/fdecebbfcaac4510bbcee1c3182f6331/users/943d2a982d8842e59c0c315a817430d8/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.694409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdecebbfcaac4510bbcee1c3182f6331, user_id=943d2a982d8842e59c0c315a817430d8, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.697148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.713011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1111/2214] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:29 2022] PUT /identity/v3/projects/fdecebbfcaac4510bbcee1c3182f6331/users/943d2a982d8842e59c0c315a817430d8/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:29.724695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a211f5-7247-4fd5-8887-a0249c5881f4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.724982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a211f5-7247-4fd5-8887-a0249c5881f4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.725260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a211f5-7247-4fd5-8887-a0249c5881f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.759965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-04a211f5-7247-4fd5-8887-a0249c5881f4 None None] MFA Rules not processed for user `943d2a982d8842e59c0c315a817430d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:29.761195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-04a211f5-7247-4fd5-8887-a0249c5881f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:29.833233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1104/2215] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:29.837942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.880922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:29.911430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34aee-99c1-4c98-ac88-08c078a85139 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.916753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.917366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.917653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.917932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.918584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.920523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.953667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1112/2216] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:29 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:29.959859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a211f5-7247-4fd5-8887-a0249c5881f4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.973311 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a211f5-7247-4fd5-8887-a0249c5881f4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.040841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.041447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.041727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.042005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.042636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.044613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.069053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1105/2217] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:29 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:30.073361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.084377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779dccb-f5e2-4901-a550-48a1ba3a684e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.089675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.090281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.090552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.090820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.091456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.093114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.103644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1113/2218] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:30.107859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.118870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9762b-31f0-470d-9a4c-ed688ce70a88 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.123949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68b59b-7c96-47e1-a9f4-e0275b04ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.124558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b59b-7c96-47e1-a9f4-e0275b04ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.124848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b59b-7c96-47e1-a9f4-e0275b04ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.125124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b59b-7c96-47e1-a9f4-e0275b04ae10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.125821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b59b-7c96-47e1-a9f4-e0275b04ae10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.127462 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b59b-7c96-47e1-a9f4-e0275b04ae10 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.138403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1106/2219] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:30.142659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.153024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed32b-f5e0-4fce-a6e2-521c1555bd9c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.157602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.158273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.158529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.158800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] PATH_INFO: `/v3/projects/654475fe773946a0a778f67d44cf7321/users/c8fff3f141574182a82478fb15ccf233/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.174122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654475fe773946a0a778f67d44cf7321, user_id=c8fff3f141574182a82478fb15ccf233, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.176852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.192722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1114/2220] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:30 2022] PUT /identity/v3/projects/654475fe773946a0a778f67d44cf7321/users/c8fff3f141574182a82478fb15ccf233/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:30.203300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c002ba-44ef-4326-8f0b-ee67833217db None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.203641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c002ba-44ef-4326-8f0b-ee67833217db None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.203947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c002ba-44ef-4326-8f0b-ee67833217db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.218781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.235695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-65c002ba-44ef-4326-8f0b-ee67833217db None None] MFA Rules not processed for user `c8fff3f141574182a82478fb15ccf233`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:30.236938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-65c002ba-44ef-4326-8f0b-ee67833217db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:30.319860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1107/2221] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:30.324670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.396373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9bcc1-42c1-4c16-a82e-ef9008638189 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.402134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.403008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.403290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.403652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.404505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.406522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.440771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1115/2222] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:30 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:30.445121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c002ba-44ef-4326-8f0b-ee67833217db None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.456528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c002ba-44ef-4326-8f0b-ee67833217db None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.517095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.517697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.517973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.518244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.518876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.520836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.552903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1108/2223] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:30 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:30.554723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.572262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d44b0-6e9a-4a3b-8490-b229debcd443 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.580041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.580676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.580952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.581218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.582076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.584367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.601005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1116/2224] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:30.603141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.614274 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345bf6-3c8a-4bb3-8dd3-e44e43101c2f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.619231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.619931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.620212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.620484 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] PATH_INFO: `/v3/projects/4182a428aafb4dd4b71d01e03a171846/users/a3e92a912abd4a29bb473288b7b76419/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.642336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4182a428aafb4dd4b71d01e03a171846, user_id=a3e92a912abd4a29bb473288b7b76419, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.645217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.659932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1109/2225] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:30 2022] PUT /identity/v3/projects/4182a428aafb4dd4b71d01e03a171846/users/a3e92a912abd4a29bb473288b7b76419/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:30.664029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.675038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bcb32-790f-46ed-ad70-9160067ada3d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.734122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece830cb-cd6e-4070-b87a-3f68c14833b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.734731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece830cb-cd6e-4070-b87a-3f68c14833b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.735002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece830cb-cd6e-4070-b87a-3f68c14833b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.735270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece830cb-cd6e-4070-b87a-3f68c14833b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.735936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece830cb-cd6e-4070-b87a-3f68c14833b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.737665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece830cb-cd6e-4070-b87a-3f68c14833b1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.738935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.750007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1117/2226] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:30.754035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.765289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069705d-77b0-4482-87e3-42f14a70c019 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.770909 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.771577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.771887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.772160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] PATH_INFO: `/v3/projects/4182a428aafb4dd4b71d01e03a171846/users/a3e92a912abd4a29bb473288b7b76419/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.774168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4182a428aafb4dd4b71d01e03a171846, user_id=a3e92a912abd4a29bb473288b7b76419, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:30.777004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:30.787599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1110/2227] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:30 2022] PUT /identity/v3/projects/4182a428aafb4dd4b71d01e03a171846/users/a3e92a912abd4a29bb473288b7b76419/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:30.798074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feea696-6cd6-4655-a797-86b51b920bab None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.798375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feea696-6cd6-4655-a797-86b51b920bab None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.798648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feea696-6cd6-4655-a797-86b51b920bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.829331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6feea696-6cd6-4655-a797-86b51b920bab None None] MFA Rules not processed for user `a3e92a912abd4a29bb473288b7b76419`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:30.830567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6feea696-6cd6-4655-a797-86b51b920bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:30.902689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1118/2228] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:31:30.914494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.916866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:30.977397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.981661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9d64-3ad7-49a7-ba02-a92693e6739d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:30.986990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:30.987848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.988191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.988782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.053603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.055072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.067307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1111/2229] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:33.719339 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feea696-6cd6-4655-a797-86b51b920bab None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:33.730132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feea696-6cd6-4655-a797-86b51b920bab None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:33.735434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:33.736074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:33.736349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:33.736623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:33.798092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:33.799450 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:33.812064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1119/2230] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:34.435711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:34.437224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:34.449257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8715a-74bb-4d51-a505-7d2192d2b8a1 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:34.453247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c298a-c5c1-477c-9d34-2b7440e42488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:34.454024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c298a-c5c1-477c-9d34-2b7440e42488 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.454294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c298a-c5c1-477c-9d34-2b7440e42488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.454620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c298a-c5c1-477c-9d34-2b7440e42488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.465085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c298a-c5c1-477c-9d34-2b7440e42488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:34.466521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c298a-c5c1-477c-9d34-2b7440e42488 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:34.475937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1112/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:38.444592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:38.511778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f91ae-5aae-4f53-aa86-22d4e5258d11 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:38.516298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:38.516946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.517223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.517492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] PATH_INFO: `/v3/users/943d2a982d8842e59c0c315a817430d8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.518798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=943d2a982d8842e59c0c315a817430d8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:38.520807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:38.547976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:38.580037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '943d2a982d8842e59c0c315a817430d8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:38.589319 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '943d2a982d8842e59c0c315a817430d8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:38.589952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '943d2a982d8842e59c0c315a817430d8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:38.599465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '943d2a982d8842e59c0c315a817430d8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:38.619351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '943d2a982d8842e59c0c315a817430d8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:38.625618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1120/2232] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:38 2022] DELETE /identity/v3/users/943d2a982d8842e59c0c315a817430d8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:38.630161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.630666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.630778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.650772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:38.652038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:38.725505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1113/2233] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:38.735998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:38.737455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:38.798575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b5b61-71d9-4cbc-bc21-e2dda8c98919 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:38.802387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:38.803413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.803903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.804235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.813407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:38.814906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:38.824805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1121/2234] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:39.134734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.136234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:39.148272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d0c5-bfb6-4561-a150-1b5befc0a061 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.154269 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.154913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.155192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.155461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] PATH_INFO: `/v3/projects/fdecebbfcaac4510bbcee1c3182f6331` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.156775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdecebbfcaac4510bbcee1c3182f6331)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.158695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.209154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdecebbfcaac4510bbcee1c3182f6331', 'request_id': 'req-c63601bc-4724-4fa9-89b8-84cd99f9517d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.214920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdecebbfcaac4510bbcee1c3182f6331', 'request_id': 'req-c63601bc-4724-4fa9-89b8-84cd99f9517d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.221281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdecebbfcaac4510bbcee1c3182f6331', 'request_id': 'req-c63601bc-4724-4fa9-89b8-84cd99f9517d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.236369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] The token cache is being invalidate because project fdecebbfcaac4510bbcee1c3182f6331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:39.236657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.237282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.238803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1114/2235] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:39 2022] DELETE /identity/v3/projects/fdecebbfcaac4510bbcee1c3182f6331 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:39.242951 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.252913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690846a0-a779-4849-a206-308bfaea92f4 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.320859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.321494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.321942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.322217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] PATH_INFO: `/v3/users/c8fff3f141574182a82478fb15ccf233` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.323504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fff3f141574182a82478fb15ccf233)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.325527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.379988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.383242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fff3f141574182a82478fb15ccf233'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.400882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fff3f141574182a82478fb15ccf233'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.401514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fff3f141574182a82478fb15ccf233'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.411925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fff3f141574182a82478fb15ccf233'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.425814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fff3f141574182a82478fb15ccf233'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:39.432766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1122/2236] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:39 2022] DELETE /identity/v3/users/c8fff3f141574182a82478fb15ccf233 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:39.850709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.853381 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:39.894001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63601bc-4724-4fa9-89b8-84cd99f9517d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.905989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.972481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.973137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.973423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.973697 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] PATH_INFO: `/v3/projects/654475fe773946a0a778f67d44cf7321` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.974843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] RBAC: Authorizing `identity:delete_project(project_id=654475fe773946a0a778f67d44cf7321)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.976816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.031682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654475fe773946a0a778f67d44cf7321', 'request_id': 'req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.037734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654475fe773946a0a778f67d44cf7321', 'request_id': 'req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.044182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654475fe773946a0a778f67d44cf7321', 'request_id': 'req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.058946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] The token cache is being invalidate because project 654475fe773946a0a778f67d44cf7321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:40.059240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.059917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.061552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1115/2237] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:39 2022] DELETE /identity/v3/projects/654475fe773946a0a778f67d44cf7321 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:40.065534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.067032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:40.080405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763dc883-1441-4e67-9765-13bc07748716 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.141890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.142533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.142812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.143086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] PATH_INFO: `/v3/users/a3e92a912abd4a29bb473288b7b76419` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.144257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e92a912abd4a29bb473288b7b76419)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.146184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.210101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e92a912abd4a29bb473288b7b76419'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.220063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e92a912abd4a29bb473288b7b76419'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.220877 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e92a912abd4a29bb473288b7b76419'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.228922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e92a912abd4a29bb473288b7b76419'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.241470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-50450091-497b-45c8-997d-c707ecc4566f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e92a912abd4a29bb473288b7b76419'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.247848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1123/2238] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:31:40 2022] DELETE /identity/v3/users/a3e92a912abd4a29bb473288b7b76419 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:40.550529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.552344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:40.574563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc063c-42b4-4c7a-b34c-5d77bfaf170e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.639138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.639813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.640092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.640362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] PATH_INFO: `/v3/projects/4182a428aafb4dd4b71d01e03a171846` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.641489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4182a428aafb4dd4b71d01e03a171846)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.643398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.689512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:40.692874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4182a428aafb4dd4b71d01e03a171846', 'request_id': 'req-25be661f-d732-4446-b38f-1eba3ae9922c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.699661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4182a428aafb4dd4b71d01e03a171846', 'request_id': 'req-25be661f-d732-4446-b38f-1eba3ae9922c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.706339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4182a428aafb4dd4b71d01e03a171846', 'request_id': 'req-25be661f-d732-4446-b38f-1eba3ae9922c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.724293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] The token cache is being invalidate because project 4182a428aafb4dd4b71d01e03a171846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:31:40.724503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.727993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-25be661f-d732-4446-b38f-1eba3ae9922c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:31:40.730073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1116/2239] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:31:40 2022] DELETE /identity/v3/projects/4182a428aafb4dd4b71d01e03a171846 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:40.734831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dfc3c-769d-41ce-9bba-8a36509c8ec0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.735169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dfc3c-769d-41ce-9bba-8a36509c8ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.735721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7dfc3c-769d-41ce-9bba-8a36509c8ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.757442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7e7dfc3c-769d-41ce-9bba-8a36509c8ec0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:40.758709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7e7dfc3c-769d-41ce-9bba-8a36509c8ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:40.810881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:40.839238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1124/2240] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:40.848278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8ab4c-cd2a-4bcf-93e1-997d3948b0a2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.848590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8ab4c-cd2a-4bcf-93e1-997d3948b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.848862 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8ab4c-cd2a-4bcf-93e1-997d3948b0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.869109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-85d8ab4c-cd2a-4bcf-93e1-997d3948b0a2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:40.870322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-85d8ab4c-cd2a-4bcf-93e1-997d3948b0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:40.878117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1117/2241] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:40.882370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dfc3c-769d-41ce-9bba-8a36509c8ec0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.893222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7dfc3c-769d-41ce-9bba-8a36509c8ec0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.898000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.898610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.898884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.899173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.899934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:40.900230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.901978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.914137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1125/2242] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:40.919020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8ab4c-cd2a-4bcf-93e1-997d3948b0a2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.929454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8ab4c-cd2a-4bcf-93e1-997d3948b0a2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.934322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.935175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.935513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.935889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.936990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.938879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.972172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1118/2243] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:31:40 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:40.976375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.987084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e649dc6-2e94-43d1-9f7b-21b5ea5e912f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.048600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.049205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.049479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.049752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.050397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.052522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.076653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1126/2244] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:40 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:41.081031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.091836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014683a-d598-4789-baf6-159de5718b67 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.096588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.097197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.097483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.097739 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.098397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.100050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.111103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1119/2245] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:41.114995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.125893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b23fa6-2061-442f-a57d-5aa64f0aaa54 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.134020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a56b4b-6422-4468-adef-3045248da80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.134558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56b4b-6422-4468-adef-3045248da80d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.134998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56b4b-6422-4468-adef-3045248da80d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.135273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a56b4b-6422-4468-adef-3045248da80d admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.136840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a56b4b-6422-4468-adef-3045248da80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.138598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a56b4b-6422-4468-adef-3045248da80d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.152631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1127/2246] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:41.156871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.168541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798dc28-1507-454d-a248-da3eda7dbf52 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.174239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.174921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.175232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.175448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] PATH_INFO: `/v3/projects/d15b096c5fde49a38404603f1d56d7b8/users/28387288d42d4c6292a9b9587a1edbed/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.208279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15b096c5fde49a38404603f1d56d7b8, user_id=28387288d42d4c6292a9b9587a1edbed, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.211330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.235828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1120/2247] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:31:41 2022] PUT /identity/v3/projects/d15b096c5fde49a38404603f1d56d7b8/users/28387288d42d4c6292a9b9587a1edbed/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:41.240885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c389-b463-461f-99a0-a4b0da9ef8c3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.241317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c389-b463-461f-99a0-a4b0da9ef8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.241635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7c389-b463-461f-99a0-a4b0da9ef8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.267826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-26c7c389-b463-461f-99a0-a4b0da9ef8c3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:41.269394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-26c7c389-b463-461f-99a0-a4b0da9ef8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:41.335576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1128/2248] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:41.345813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.347723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:41.406783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195290f-70ed-4847-8da3-5511fd51509e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.410634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.411336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.411710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.412050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.421628 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.423147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.433235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1121/2249] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:42.101418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba3edd-ab6d-444b-8fef-25e3e4fc5212 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:42.102004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba3edd-ab6d-444b-8fef-25e3e4fc5212 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:42.102004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba3edd-ab6d-444b-8fef-25e3e4fc5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:42.131277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-15ba3edd-ab6d-444b-8fef-25e3e4fc5212 None None] MFA Rules not processed for user `28387288d42d4c6292a9b9587a1edbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:42.132590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-15ba3edd-ab6d-444b-8fef-25e3e4fc5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:42.166714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:42.207006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1129/2250] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:42.214172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:42.215851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:42.284244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0bc228-7fc7-4694-a5cf-f01e462958ac service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:42.287923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082efb6-7e79-4de0-b2c3-fa7abfc02c86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:42.288534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082efb6-7e79-4de0-b2c3-fa7abfc02c86 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:42.288806 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082efb6-7e79-4de0-b2c3-fa7abfc02c86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:42.289069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082efb6-7e79-4de0-b2c3-fa7abfc02c86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:42.298237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082efb6-7e79-4de0-b2c3-fa7abfc02c86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:42.300066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082efb6-7e79-4de0-b2c3-fa7abfc02c86 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:42.310635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1122/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:43.728116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:43.728719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:43.728719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:43.749129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] MFA Rules not processed for user `28387288d42d4c6292a9b9587a1edbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:43.750362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:43.758318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1130/2252] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:31:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:47.995858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c949-dd0e-4aca-ae3d-82ef6319644d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:47.996395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c949-dd0e-4aca-ae3d-82ef6319644d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:47.996395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176c949-dd0e-4aca-ae3d-82ef6319644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:48.020194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0176c949-dd0e-4aca-ae3d-82ef6319644d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:48.021435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0176c949-dd0e-4aca-ae3d-82ef6319644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:48.031990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1123/2253] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:48.054847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:48.056220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:48.132549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8287af2-8599-4fdf-8a85-c770f2ef8bd2 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:48.138157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:48.138772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:48.139047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:48.139315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:48.147615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:48.149212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:48.159062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1131/2254] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:52.084150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:52.084720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:52.084720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:52.106270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:52.107622 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:52.117061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1124/2255] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:52.144679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:52.146832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:52.169880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c95e10-3b03-4863-90cc-3b870720b423 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:52.177090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a96a7-3b45-4ad1-972b-484b86bbc977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:52.178052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a96a7-3b45-4ad1-972b-484b86bbc977 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:52.178335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a96a7-3b45-4ad1-972b-484b86bbc977 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:52.178599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a96a7-3b45-4ad1-972b-484b86bbc977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:52.188790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a96a7-3b45-4ad1-972b-484b86bbc977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:52.190397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a96a7-3b45-4ad1-972b-484b86bbc977 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:52.201336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1132/2256] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:56.513047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:56.514504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:56.521635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:56.528520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167050f-c1f2-4582-b5a0-7c7c65216e64 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:56.532756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:56.533619 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:56.534066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:56.534439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:56.536394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:56.606901 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:56.609142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:56.620411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1125/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:31:58.460949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a185-20fe-4384-8550-b13335d2cd03 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.461733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a185-20fe-4384-8550-b13335d2cd03 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.462156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402a185-20fe-4384-8550-b13335d2cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.484994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b402a185-20fe-4384-8550-b13335d2cd03 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:58.487845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b402a185-20fe-4384-8550-b13335d2cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:58.497802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1133/2258] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:31:58.523517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.537090 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a6ddf-17f1-4d13-9839-5fa3c8f790a2 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.542419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.543036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.543313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.543898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.553074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.554644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.574829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1126/2259] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:32:05.730263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b9fe-b98a-4b50-ab2e-58a8810018a2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.730784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b9fe-b98a-4b50-ab2e-58a8810018a2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.730784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b9fe-b98a-4b50-ab2e-58a8810018a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.752427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a4a4b9fe-b98a-4b50-ab2e-58a8810018a2 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:05.753626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a4a4b9fe-b98a-4b50-ab2e-58a8810018a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:05.762790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1134/2260] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:32:05.785617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:05.797579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21583424-e5ac-4196-98d6-7810c8d4b184 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:05.805414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a14c2-9d7d-45d3-8fd3-f18f945901cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:05.806009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a14c2-9d7d-45d3-8fd3-f18f945901cc service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.806280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a14c2-9d7d-45d3-8fd3-f18f945901cc service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.806544 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a14c2-9d7d-45d3-8fd3-f18f945901cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.815446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a14c2-9d7d-45d3-8fd3-f18f945901cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:05.817081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a14c2-9d7d-45d3-8fd3-f18f945901cc service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:05.827075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1127/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:32:15.404957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f59048-f770-46f4-971d-0f27819f7d1d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:15.405522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f59048-f770-46f4-971d-0f27819f7d1d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:15.405522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f59048-f770-46f4-971d-0f27819f7d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:15.413183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=61 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:15.426815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-99f59048-f770-46f4-971d-0f27819f7d1d None None] MFA Rules not processed for user `14edcf1140f840679b671523b5c29d38`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:15.428408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-99f59048-f770-46f4-971d-0f27819f7d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:15.486725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1135/2262] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:32:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:32:15.822409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=41 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:15.954192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4d5a-2598-4bf1-b9fb-d34558432337 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:15.954463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4d5a-2598-4bf1-b9fb-d34558432337 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:15.954758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4d5a-2598-4bf1-b9fb-d34558432337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:15.975805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-cb0b4d5a-2598-4bf1-b9fb-d34558432337 None None] MFA Rules not processed for user `28387288d42d4c6292a9b9587a1edbed`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:15.977038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cb0b4d5a-2598-4bf1-b9fb-d34558432337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:15.985163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1128/2263] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:32:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:32:16.186621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc274b-620e-44d5-b61a-6c123af7694a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:16.187124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc274b-620e-44d5-b61a-6c123af7694a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:16.187658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc274b-620e-44d5-b61a-6c123af7694a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:16.220026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-34cc274b-620e-44d5-b61a-6c123af7694a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:16.222252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-34cc274b-620e-44d5-b61a-6c123af7694a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:16.238304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1136/2264] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:32:16.263851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b4d5a-2598-4bf1-b9fb-d34558432337 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:16.280125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b4d5a-2598-4bf1-b9fb-d34558432337 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:16.289596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:16.290284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:16.290629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:16.290967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:16.300740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:16.302819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:16.313291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1129/2265] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:32:20.398015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb0c35-415f-4841-8681-0bc245596de5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:20.398565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb0c35-415f-4841-8681-0bc245596de5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:20.398659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb0c35-415f-4841-8681-0bc245596de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:20.418478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-07bb0c35-415f-4841-8681-0bc245596de5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:20.420085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-07bb0c35-415f-4841-8681-0bc245596de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:20.429607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1137/2266] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:32:20.457127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:20.470458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca546fe-e2bb-45f7-9c19-f59fa39dee65 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:20.479335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:20.480085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:20.480458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:20.480823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:20.489956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:20.491780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:20.501991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1130/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:32:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:32:26.024145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03559e3-eaa1-4afa-9cc0-bd76e9f287eb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:26.025207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03559e3-eaa1-4afa-9cc0-bd76e9f287eb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:26.025485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03559e3-eaa1-4afa-9cc0-bd76e9f287eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:26.046486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e03559e3-eaa1-4afa-9cc0-bd76e9f287eb None None] MFA Rules not processed for user `bebd3b0bcdc04e77945fb9ddf8ca2d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:26.047799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e03559e3-eaa1-4afa-9cc0-bd76e9f287eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:26.108212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1138/2268] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:32:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:32:29.706832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:29.708444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:29.782705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ba0f-74b8-4210-a87e-fe9ef540bba5 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:29.788675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e2cef-c5e8-4e52-b425-84c86fe16442 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:29.789428 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2cef-c5e8-4e52-b425-84c86fe16442 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:29.789814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2cef-c5e8-4e52-b425-84c86fe16442 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:29.790040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e2cef-c5e8-4e52-b425-84c86fe16442 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:29.792236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-065e2cef-c5e8-4e52-b425-84c86fe16442 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:29.806337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e2cef-c5e8-4e52-b425-84c86fe16442 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:29.807897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e2cef-c5e8-4e52-b425-84c86fe16442 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:29.818474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1131/2269] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:32:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:32:36.100764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=55 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:39.813821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=47 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:49.488215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:49.488774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:49.488774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:49.508316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] MFA Rules not processed for user `c0f41b58218e42f29e7a619f022e6693`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:49.509666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:49.573103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1139/2270] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:32:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:32:59.566090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=25 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:02.314895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf3cee-965d-4a6d-93bb-a4c41372c4de None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:02.315375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf3cee-965d-4a6d-93bb-a4c41372c4de None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:02.315476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf3cee-965d-4a6d-93bb-a4c41372c4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:02.335217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-7fbf3cee-965d-4a6d-93bb-a4c41372c4de None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:02.336524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7fbf3cee-965d-4a6d-93bb-a4c41372c4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:02.396771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1132/2271] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:33:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:02.439857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:02.441374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:02.515005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736468a1-bfe3-45ad-8d9c-0c480752fce9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:02.520873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:02.521490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:02.521769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:02.522077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:02.533636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:02.535228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:02.544178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1140/2272] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:33:08.045541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a59ce7-2186-4b2e-b498-9a7fd96439d0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:08.046156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a59ce7-2186-4b2e-b498-9a7fd96439d0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:08.046561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a59ce7-2186-4b2e-b498-9a7fd96439d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:08.069496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-71a59ce7-2186-4b2e-b498-9a7fd96439d0 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:08.070771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-71a59ce7-2186-4b2e-b498-9a7fd96439d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:08.078689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1133/2273] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:33:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:08.099730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:08.115515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1108d6b-aae2-4bcd-a05a-59682b139514 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:08.121195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:08.122101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:08.122525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:08.122959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:08.132575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:08.134731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:08.144384 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1141/2274] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:33:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 05:33:15.758280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d37c-ead0-483d-9812-133965b9b109 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:15.758986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d37c-ead0-483d-9812-133965b9b109 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:15.759200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0d37c-ead0-483d-9812-133965b9b109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:15.787164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-88a0d37c-ead0-483d-9812-133965b9b109 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:15.788902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-88a0d37c-ead0-483d-9812-133965b9b109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:15.798024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1134/2275] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:33:15.825050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:15.841956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e65723-7a5f-42f5-8259-765af0bc6e15 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:15.848787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:15.849717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:15.850233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:15.850722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:15.865225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:15.867232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:15.894850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1142/2276] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:21.038910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405353b6-48af-4bd1-964b-685885f47f0f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:21.039512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405353b6-48af-4bd1-964b-685885f47f0f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:21.039745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405353b6-48af-4bd1-964b-685885f47f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:21.069466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-405353b6-48af-4bd1-964b-685885f47f0f None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:21.071481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-405353b6-48af-4bd1-964b-685885f47f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:21.082519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1135/2277] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:21.096627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:21.108376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f98e4-bdcb-4f92-84f2-82bb1097b4d9 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:21.113597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:21.114219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:21.114499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:21.114772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:21.123330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:21.125245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:21.133640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1143/2278] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:33:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:33:21.171596 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dfffd-f3ba-4886-9e64-eb3eae279832 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:21.172191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dfffd-f3ba-4886-9e64-eb3eae279832 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:21.172395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dfffd-f3ba-4886-9e64-eb3eae279832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:21.196285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a48dfffd-f3ba-4886-9e64-eb3eae279832 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:21.197588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a48dfffd-f3ba-4886-9e64-eb3eae279832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:21.206781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1136/2279] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:21.235880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:21.248605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787de89-6859-4b29-a484-b7e5059e8e57 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:21.255306 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:21.256577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:21.256861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:21.257240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:21.267142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:21.268818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:21.280171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1144/2280] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:33:23.233049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dfffd-f3ba-4886-9e64-eb3eae279832 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:23.243594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dfffd-f3ba-4886-9e64-eb3eae279832 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:23.261045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:23.261930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:23.262588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:23.263015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] PATH_INFO: `/v3/users/28387288d42d4c6292a9b9587a1edbed` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:23.264465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28387288d42d4c6292a9b9587a1edbed)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:23.266682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:23.323123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28387288d42d4c6292a9b9587a1edbed'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.332537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28387288d42d4c6292a9b9587a1edbed'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.345723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28387288d42d4c6292a9b9587a1edbed'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.346506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28387288d42d4c6292a9b9587a1edbed'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.353511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a37648e4-fc84-4ae0-8cdb-4ec3aaa69e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28387288d42d4c6292a9b9587a1edbed'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.359504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1137/2281] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:33:23 2022] DELETE /identity/v3/users/28387288d42d4c6292a9b9587a1edbed => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:33:23.601885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:23.621839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f84080-5470-48cd-a61d-7a2652481acc service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:23.684032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:23.684589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:23.684894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:23.685163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] PATH_INFO: `/v3/projects/d15b096c5fde49a38404603f1d56d7b8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:23.686267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15b096c5fde49a38404603f1d56d7b8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:23.688234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:23.733874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:23.741690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15b096c5fde49a38404603f1d56d7b8', 'request_id': 'req-3d355aa1-d593-45bf-acc8-5ae878023dab'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.751662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15b096c5fde49a38404603f1d56d7b8', 'request_id': 'req-3d355aa1-d593-45bf-acc8-5ae878023dab'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.758389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15b096c5fde49a38404603f1d56d7b8', 'request_id': 'req-3d355aa1-d593-45bf-acc8-5ae878023dab'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.769484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] The token cache is being invalidate because project d15b096c5fde49a38404603f1d56d7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:33:23.769776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.770433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3d355aa1-d593-45bf-acc8-5ae878023dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:33:23.772024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1145/2282] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:33:23 2022] DELETE /identity/v3/projects/d15b096c5fde49a38404603f1d56d7b8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:33:23.777755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120efb-1c36-452b-9627-d84ae0f45fd4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:23.778140 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120efb-1c36-452b-9627-d84ae0f45fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:23.778505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15120efb-1c36-452b-9627-d84ae0f45fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:23.799713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-15120efb-1c36-452b-9627-d84ae0f45fd4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:23.800923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-15120efb-1c36-452b-9627-d84ae0f45fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:23.848570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:23.865106 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1138/2283] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:23.932910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c6ed-b168-48fc-9902-b18a03a37b32 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:23.933195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c6ed-b168-48fc-9902-b18a03a37b32 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:23.933698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3c6ed-b168-48fc-9902-b18a03a37b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:23.955883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f6b3c6ed-b168-48fc-9902-b18a03a37b32 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:23.957033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f6b3c6ed-b168-48fc-9902-b18a03a37b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:23.966118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1146/2284] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:23.970563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15120efb-1c36-452b-9627-d84ae0f45fd4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:23.981369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15120efb-1c36-452b-9627-d84ae0f45fd4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:23.986957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:23.987573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:23.987876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:23.988143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:23.988819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:33:23.989123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:23.990734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:24.004145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1139/2285] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:33:24.008312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3c6ed-b168-48fc-9902-b18a03a37b32 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:24.018035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3c6ed-b168-48fc-9902-b18a03a37b32 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:24.022861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:24.023481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:24.023800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:24.024113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:24.024778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:24.027482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:24.064980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1147/2286] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:33:24 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:33:24.066493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:24.077070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bffa3-60fd-4cff-98ba-8299fe610ed6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:24.139575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:24.140231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:24.140514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:24.140784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:24.141430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:24.143440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:24.170876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1140/2287] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:33:24 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:33:24.173489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:24.194177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47434a9d-e5b5-4b48-b7ad-1dca93fc9911 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:24.200618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:24.202147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:24.202584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:24.202919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:24.204563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:24.207245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:24.222729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1148/2288] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:33:24.226956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:24.238373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013de14-f78a-48c9-a8c3-8e3d86799da4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:24.243422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f0285-1707-44aa-9213-6e48e51ccfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:24.244063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0285-1707-44aa-9213-6e48e51ccfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:24.244340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0285-1707-44aa-9213-6e48e51ccfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:24.244611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f0285-1707-44aa-9213-6e48e51ccfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:24.245648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f0285-1707-44aa-9213-6e48e51ccfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:24.247275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f0285-1707-44aa-9213-6e48e51ccfa4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:24.258549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1141/2289] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:33:24.263079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:24.273210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758787ee-d604-4ef7-ad7e-afb582478fa3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:24.278886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:24.279711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:24.285106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:24.285106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] PATH_INFO: `/v3/projects/d5ffb352f60c431db02da966fbb4d777/users/39558065333c4a00888011aff539ee6c/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:24.304599 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ffb352f60c431db02da966fbb4d777, user_id=39558065333c4a00888011aff539ee6c, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:24.307442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:24.322668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1149/2290] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:33:24 2022] PUT /identity/v3/projects/d5ffb352f60c431db02da966fbb4d777/users/39558065333c4a00888011aff539ee6c/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:33:24.328313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f607b-40a1-4a8e-85c8-8f845f9a2095 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:24.328594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f607b-40a1-4a8e-85c8-8f845f9a2095 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:24.328863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f607b-40a1-4a8e-85c8-8f845f9a2095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:24.348738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ab5f607b-40a1-4a8e-85c8-8f845f9a2095 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:24.349963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ab5f607b-40a1-4a8e-85c8-8f845f9a2095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:24.415365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1142/2291] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:24.425099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:24.428542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:24.488034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7acd-4679-4061-a804-41113018ef2e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:24.494502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:24.495440 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:24.495803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:24.496076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:24.506139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:24.507584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:24.520416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1150/2292] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:33:26.263002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f35c-a93b-42a7-b809-49c4bda7dcdb None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:26.263568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f35c-a93b-42a7-b809-49c4bda7dcdb None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:26.263568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f35c-a93b-42a7-b809-49c4bda7dcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:26.288099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8a08f35c-a93b-42a7-b809-49c4bda7dcdb None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:26.289210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8a08f35c-a93b-42a7-b809-49c4bda7dcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:26.302102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1143/2293] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:26.330255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:26.332608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:26.409130 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:26.414072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f141a2-c31b-4e55-91dc-4a9eaea7a8b4 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:26.421629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:26.422577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:26.422974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:26.423308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:26.434207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:26.435881 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:26.445796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1151/2294] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:28.914129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e6ec9-3697-451a-ac18-cc2f2d8b6973 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:28.914629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e6ec9-3697-451a-ac18-cc2f2d8b6973 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:28.914814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e6ec9-3697-451a-ac18-cc2f2d8b6973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:28.949213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-856e6ec9-3697-451a-ac18-cc2f2d8b6973 None None] MFA Rules not processed for user `39558065333c4a00888011aff539ee6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:28.950442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-856e6ec9-3697-451a-ac18-cc2f2d8b6973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:29.001630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:29.035031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1144/2295] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:33:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:29.039950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:29.054506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae690db-f160-4f5b-b001-50ecd262ed5c service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:29.061769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:29.062584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:29.062875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:29.063142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:29.065064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:29.066994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:29.105146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1152/2296] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:33:29 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:33:29.109047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e6ec9-3697-451a-ac18-cc2f2d8b6973 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:29.122125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e6ec9-3697-451a-ac18-cc2f2d8b6973 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:29.232511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:29.233314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:29.233599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:29.233872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:29.235167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:29.237179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:29.266448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:29.267065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1145/2297] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:33:29 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:33:29.283300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd24562-438f-43a9-b895-fb4bb221dd0b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:29.301990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:29.302629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:29.302911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:29.303224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:29.303917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:29.307638 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:29.321546 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1153/2298] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:33:29.325991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:29.338767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1ec6a-0fde-4d92-beeb-17052db141a4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:29.343858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:29.344666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:29.345456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:29.346012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] PATH_INFO: `/v3/projects/e4a21b522d3f4eeda1cbcae125b39c02/users/e51cbe87166f414aa0742aabd736258f/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:29.366550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a21b522d3f4eeda1cbcae125b39c02, user_id=e51cbe87166f414aa0742aabd736258f, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:29.369347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:29.391034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1146/2299] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:33:29 2022] PUT /identity/v3/projects/e4a21b522d3f4eeda1cbcae125b39c02/users/e51cbe87166f414aa0742aabd736258f/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:33:29.394777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:29.406263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f7f32-45bf-471c-b7f7-8052318474cf admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:29.467187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad4b60-fb77-4475-b28a-7ff50dce8461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:29.467867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad4b60-fb77-4475-b28a-7ff50dce8461 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:29.468245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad4b60-fb77-4475-b28a-7ff50dce8461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:29.468580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad4b60-fb77-4475-b28a-7ff50dce8461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:29.469243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad4b60-fb77-4475-b28a-7ff50dce8461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:29.470840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad4b60-fb77-4475-b28a-7ff50dce8461 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:29.484679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1154/2300] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:33:29.486027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:29.497088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1557d29-02e9-480d-b0af-efef892ab10c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:29.502250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7cd65-8048-4599-8d7c-173226f4d990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:29.503105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7cd65-8048-4599-8d7c-173226f4d990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:29.503490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7cd65-8048-4599-8d7c-173226f4d990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:29.503898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7cd65-8048-4599-8d7c-173226f4d990 admin admin] PATH_INFO: `/v3/projects/e4a21b522d3f4eeda1cbcae125b39c02/users/e51cbe87166f414aa0742aabd736258f/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:29.506164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7cd65-8048-4599-8d7c-173226f4d990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a21b522d3f4eeda1cbcae125b39c02, user_id=e51cbe87166f414aa0742aabd736258f, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:29.509151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7cd65-8048-4599-8d7c-173226f4d990 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:29.523754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1147/2301] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:33:29 2022] PUT /identity/v3/projects/e4a21b522d3f4eeda1cbcae125b39c02/users/e51cbe87166f414aa0742aabd736258f/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:33:30.261865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4988a8-6479-43b3-805f-0f7d6a3603a0 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.262424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4988a8-6479-43b3-805f-0f7d6a3603a0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.262424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4988a8-6479-43b3-805f-0f7d6a3603a0 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:30.264054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1155/2302] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:33:30.274799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa16a3-bbe6-4a8a-8330-d0a69b56765a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.275354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa16a3-bbe6-4a8a-8330-d0a69b56765a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.275601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa16a3-bbe6-4a8a-8330-d0a69b56765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:30.331515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fefa16a3-bbe6-4a8a-8330-d0a69b56765a None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:30.332910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fefa16a3-bbe6-4a8a-8330-d0a69b56765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:30.476077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1148/2303] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:30.490639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4988a8-6479-43b3-805f-0f7d6a3603a0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:30.493095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7f4988a8-6479-43b3-805f-0f7d6a3603a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:30.578592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4988a8-6479-43b3-805f-0f7d6a3603a0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:30.584223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5a3dc-2fc1-4fc1-b1f9-6ca6eb73fbc8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78fc219a25457ca11e38930b03e8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:30.585040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a3dc-2fc1-4fc1-b1f9-6ca6eb73fbc8 service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.585434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a3dc-2fc1-4fc1-b1f9-6ca6eb73fbc8 service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.585827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5a3dc-2fc1-4fc1-b1f9-6ca6eb73fbc8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:30.599568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5a3dc-2fc1-4fc1-b1f9-6ca6eb73fbc8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:30.601081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5a3dc-2fc1-4fc1-b1f9-6ca6eb73fbc8 service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:30.615223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1156/2304] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:30.708503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a917-99a5-4835-8c7b-f57456865d00 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.708798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a917-99a5-4835-8c7b-f57456865d00 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.709072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a917-99a5-4835-8c7b-f57456865d00 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:30.710448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1149/2305] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:33:30.716270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721c19a-8ed3-4e67-932d-79efba4aba41 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.717120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721c19a-8ed3-4e67-932d-79efba4aba41 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.717617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721c19a-8ed3-4e67-932d-79efba4aba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:30.743903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1721c19a-8ed3-4e67-932d-79efba4aba41 None None] MFA Rules not processed for user `de2913a65aac4fda97bc92dbf15d3316`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:30.745544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1721c19a-8ed3-4e67-932d-79efba4aba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:30.829692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1157/2306] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:30.842357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a917-99a5-4835-8c7b-f57456865d00 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:30.857018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a917-99a5-4835-8c7b-f57456865d00 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:30.863209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b54d35-1826-4c57-8870-aa72f01d58ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:30.863888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54d35-1826-4c57-8870-aa72f01d58ad service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.864536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54d35-1826-4c57-8870-aa72f01d58ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.864536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54d35-1826-4c57-8870-aa72f01d58ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:30.873905 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b54d35-1826-4c57-8870-aa72f01d58ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:30.875429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b54d35-1826-4c57-8870-aa72f01d58ad service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:30.887142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1150/2307] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:30.988440 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212dcd1-129d-4d19-8c88-9be8ece97157 None None] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.988679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212dcd1-129d-4d19-8c88-9be8ece97157 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.988985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212dcd1-129d-4d19-8c88-9be8ece97157 None None] PATH_INFO: `/` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:30.990483 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1158/2308] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:33:30.998032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ca1c-c03e-43e3-9894-e4c3c9af20be None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:30.998670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ca1c-c03e-43e3-9894-e4c3c9af20be None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:30.999620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ca1c-c03e-43e3-9894-e4c3c9af20be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:31.033351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5809ca1c-c03e-43e3-9894-e4c3c9af20be None None] MFA Rules not processed for user `291c79a765764420a4b836c478c385b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:31.034788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5809ca1c-c03e-43e3-9894-e4c3c9af20be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:31.048225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1151/2309] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:31.060032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212dcd1-129d-4d19-8c88-9be8ece97157 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:31.071528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212dcd1-129d-4d19-8c88-9be8ece97157 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:31.075357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:31.076029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:31.076309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:31.076582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:31.085511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:31.090668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:31.092723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:31.106589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1159/2310] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:31.576183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9444-9cdc-4631-88f4-97ad120c3379 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:31.577326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9444-9cdc-4631-88f4-97ad120c3379 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:31.577884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9444-9cdc-4631-88f4-97ad120c3379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:31.591667 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:31.621834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a61e9444-9cdc-4631-88f4-97ad120c3379 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:31.623651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a61e9444-9cdc-4631-88f4-97ad120c3379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:31.721494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1152/2311] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:31.747027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:31.772996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0433a-324d-4de6-95a3-059891159afd service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:31.828331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:31.830214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:31.831797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:31.832016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:31.879947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:31.881588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:31.900434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1160/2312] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:34.794067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546ddb0-859d-487c-b13c-b3ca8e9e010f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:34.794583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546ddb0-859d-487c-b13c-b3ca8e9e010f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:34.794679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546ddb0-859d-487c-b13c-b3ca8e9e010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:34.823620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1546ddb0-859d-487c-b13c-b3ca8e9e010f None None] MFA Rules not processed for user `e51cbe87166f414aa0742aabd736258f`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:34.824829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1546ddb0-859d-487c-b13c-b3ca8e9e010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:34.913620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1153/2313] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:33:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:34.926498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:34.940049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e27b40-7ebf-48bc-8c7c-cbae866f85a0 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:34.944836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78fc219a25457ca11e38930b03e8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:34.945456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:34.945734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:34.946191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:35.016625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:35.018072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:35.027719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1161/2314] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:35.224881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdad53-bd91-441f-81a1-72642a20281d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:35.225285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdad53-bd91-441f-81a1-72642a20281d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:35.225772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdad53-bd91-441f-81a1-72642a20281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:35.255048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-84cdad53-bd91-441f-81a1-72642a20281d None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:35.256297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-84cdad53-bd91-441f-81a1-72642a20281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:35.353826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1154/2315] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:33:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:35.373202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:35.374749 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:35.461991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53623c-6b1c-4a7c-82cd-ed91bcf550f3 service glance] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:35.467378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:35.468116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:35.468459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:35.469079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:35.480520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:35.482344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:35.506982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1162/2316] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:33:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:33:36.947880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc36d-1341-428f-b2f5-c446d4630cf0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:36.948504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc36d-1341-428f-b2f5-c446d4630cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:36.948642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03dc36d-1341-428f-b2f5-c446d4630cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:36.984676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f03dc36d-1341-428f-b2f5-c446d4630cf0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:36.986287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f03dc36d-1341-428f-b2f5-c446d4630cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:37.001611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1155/2317] 10.222.0.48 () {58 vars in 1016 bytes} [Mon Sep 26 05:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:37.037262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:37.038757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:37.061544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59309-7a84-4cbc-aa55-82f9ee9d458f service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:37.067103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:37.067755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:37.068031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:37.068507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:37.077490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:37.079312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:37.118817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1163/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:33:40.085894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996bc2-c5bc-4ebc-a26b-45d47c1e9437 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:40.086500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996bc2-c5bc-4ebc-a26b-45d47c1e9437 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:40.086500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996bc2-c5bc-4ebc-a26b-45d47c1e9437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:40.112517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-57996bc2-c5bc-4ebc-a26b-45d47c1e9437 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:40.113745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-57996bc2-c5bc-4ebc-a26b-45d47c1e9437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:40.125125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1156/2319] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:33:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:40.138622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:40.151313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee408122-9bdb-4131-a490-c2f43f3a6f58 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:40.157598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4166743-4e5d-4cea-85d9-a6194c812c70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:40.158291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166743-4e5d-4cea-85d9-a6194c812c70 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:40.158639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166743-4e5d-4cea-85d9-a6194c812c70 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:40.159100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166743-4e5d-4cea-85d9-a6194c812c70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:40.170537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4166743-4e5d-4cea-85d9-a6194c812c70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:40.172443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4166743-4e5d-4cea-85d9-a6194c812c70 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:40.181607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1164/2320] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:33:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:33:45.362393 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262c37-08cd-45ab-8f38-271c0cc6c05a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:45.363040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262c37-08cd-45ab-8f38-271c0cc6c05a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:45.363040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87262c37-08cd-45ab-8f38-271c0cc6c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:45.382063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-87262c37-08cd-45ab-8f38-271c0cc6c05a None None] MFA Rules not processed for user `39558065333c4a00888011aff539ee6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:45.383290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-87262c37-08cd-45ab-8f38-271c0cc6c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:45.390542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1157/2321] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:33:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:33:50.178686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=81 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:55.376914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:08.733157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:08.733787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:08.733893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:08.759136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:08.760809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:08.770480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1165/2322] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:34:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:34:08.794454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87262c37-08cd-45ab-8f38-271c0cc6c05a None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:08.807086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87262c37-08cd-45ab-8f38-271c0cc6c05a None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:08.813864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c070e8d-2561-4f3e-a065-3222a090ae3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:08.814497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c070e8d-2561-4f3e-a065-3222a090ae3e service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:08.814973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c070e8d-2561-4f3e-a065-3222a090ae3e service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:08.815424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c070e8d-2561-4f3e-a065-3222a090ae3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:08.824227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c070e8d-2561-4f3e-a065-3222a090ae3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:08.825889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c070e8d-2561-4f3e-a065-3222a090ae3e service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:08.841357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1158/2323] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:34:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:34:18.751310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:18.830865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:22.430722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:22.432368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:22.452379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bfabe-779e-4f21-940b-c1cefe0f7b07 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:22.460695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:22.461644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:22.462053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:22.462423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:22.465985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:22.481926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:22.483391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:22.494430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1166/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:34:24.589022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26042255-9a81-4ae3-9ed1-85f93e0ca8f8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:24.589652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26042255-9a81-4ae3-9ed1-85f93e0ca8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:24.589924 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26042255-9a81-4ae3-9ed1-85f93e0ca8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:24.616549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-26042255-9a81-4ae3-9ed1-85f93e0ca8f8 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:24.618043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-26042255-9a81-4ae3-9ed1-85f93e0ca8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:24.627486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1159/2325] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:34:24.640536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:24.652474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ea562-1d30-4b0a-9955-433d694560a7 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:24.657392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:24.658000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:24.659310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:24.659613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:24.668043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:24.669637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:24.678406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1167/2326] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:34:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 05:34:24.958272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26042255-9a81-4ae3-9ed1-85f93e0ca8f8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:24.968581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26042255-9a81-4ae3-9ed1-85f93e0ca8f8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:24.972204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:24.972815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:24.973092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:24.973358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:24.975153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:24.991395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:24.992882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:25.005297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1160/2327] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:34:34.674706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=12 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:35.000055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=9 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:42.318349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:42.330535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32972d7-18c5-43fe-9bef-767615e67dcf service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:42.336416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:42.337006 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:42.337296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:42.337689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:42.340282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:42.405689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:42.407361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:42.417625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1168/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:34:42.621169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:42.630828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d2224-010e-4f0a-bbca-eb45cdef635b service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:42.634967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:42.635618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:42.635905 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:42.636181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:42.645832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:42.647365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:42.660171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1161/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:34:45.192840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:45.194441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:45.206386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:45.207980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:45.289752 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a32aea-179b-424e-8bcf-74ae35e909b1 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:45.294741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:45.295533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:45.296685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:45.296685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:45.298744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:45.313709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2dd1c1-0a02-4aa4-a968-d9e84f35af8e service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:45.317534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:45.318326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:45.318767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:45.319204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:45.322202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:45.408022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:45.409732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:45.420650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1162/2330] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:34:45.447808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:45.449901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:45.475882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1169/2331] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:34:47.219821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:47.221502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:47.237362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bb565-b56f-449a-8009-79d7d7ed873e service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:47.242967 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:47.243657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:47.243931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:47.244202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] PATH_INFO: `/v3/users/c0f41b58218e42f29e7a619f022e6693` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:47.245572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f41b58218e42f29e7a619f022e6693)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:47.247535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:47.302888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f41b58218e42f29e7a619f022e6693'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.314584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f41b58218e42f29e7a619f022e6693'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.328522 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f41b58218e42f29e7a619f022e6693'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.329154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f41b58218e42f29e7a619f022e6693'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.336039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5424e488-64b3-44d8-aea4-78ffddff181e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f41b58218e42f29e7a619f022e6693'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.342120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1163/2332] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:34:47 2022] DELETE /identity/v3/users/c0f41b58218e42f29e7a619f022e6693 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:34:47.531693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:47.543661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c8d-7546-48b1-800b-750960d58225 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:47.596327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:47.606670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:47.607314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:47.607634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:47.607912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] PATH_INFO: `/v3/projects/3400d35c9c7e406089d68d83c52f0d0c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:47.609064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3400d35c9c7e406089d68d83c52f0d0c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:47.611015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:47.660175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3400d35c9c7e406089d68d83c52f0d0c', 'request_id': 'req-73cbcc1c-ef08-4422-8dc5-2f2678750aca'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.668823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3400d35c9c7e406089d68d83c52f0d0c', 'request_id': 'req-73cbcc1c-ef08-4422-8dc5-2f2678750aca'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.676286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3400d35c9c7e406089d68d83c52f0d0c', 'request_id': 'req-73cbcc1c-ef08-4422-8dc5-2f2678750aca'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.687064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] The token cache is being invalidate because project 3400d35c9c7e406089d68d83c52f0d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:34:47.687349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.688017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-73cbcc1c-ef08-4422-8dc5-2f2678750aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:47.689566 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1170/2333] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:34:47 2022] DELETE /identity/v3/projects/3400d35c9c7e406089d68d83c52f0d0c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:34:47.694631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ec8a-1166-4399-96d1-2efe94414219 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:47.694923 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ec8a-1166-4399-96d1-2efe94414219 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:47.695307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695ec8a-1166-4399-96d1-2efe94414219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:47.716324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a695ec8a-1166-4399-96d1-2efe94414219 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:47.717597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a695ec8a-1166-4399-96d1-2efe94414219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:47.731590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:47.792305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1164/2334] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:34:47.801627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa259a-8f8b-4edc-987a-244500d0331f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:47.801912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa259a-8f8b-4edc-987a-244500d0331f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:47.802187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa259a-8f8b-4edc-987a-244500d0331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:47.823215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a0aa259a-8f8b-4edc-987a-244500d0331f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:47.824475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a0aa259a-8f8b-4edc-987a-244500d0331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:47.833393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1171/2335] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:34:47.838629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ec8a-1166-4399-96d1-2efe94414219 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:47.855845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695ec8a-1166-4399-96d1-2efe94414219 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:47.863587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:47.864385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:47.865221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:47.865598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:47.866369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:47.866780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:47.868518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:47.879991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1165/2336] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:34:47.944499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa259a-8f8b-4edc-987a-244500d0331f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:47.959512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa259a-8f8b-4edc-987a-244500d0331f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:47.966204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:47.966806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:47.967112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:47.967374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:47.968040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:47.969979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:48.000519 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1172/2337] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:34:47 2022] POST /identity/v3/projects => generated 397 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:34:48.004865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:48.015880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5655c-c059-4b4b-a593-60ebc3945b70 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:48.080079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:48.080968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:48.081246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:48.081517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:48.082168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:48.084129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:48.108888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1166/2338] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:34:48 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:34:48.113248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:48.124157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef4ea6-2e69-417f-894d-b41abc479e13 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:48.129078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:48.129682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:48.130455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:48.130455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:48.130841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:48.132849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:48.144435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1173/2339] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:34:48.148773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:48.159068 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fad6f2b-d678-485f-a424-406ce3667556 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:48.163767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ce172-94a3-4a95-b7d8-962afb022ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:48.164380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ce172-94a3-4a95-b7d8-962afb022ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:48.164748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ce172-94a3-4a95-b7d8-962afb022ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:48.165028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ce172-94a3-4a95-b7d8-962afb022ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:48.165714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ce172-94a3-4a95-b7d8-962afb022ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:48.167324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ce172-94a3-4a95-b7d8-962afb022ba7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:48.178482 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1167/2340] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:34:48.182933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:48.193262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf6e89-cf3a-4a4e-8344-ec5dd5a086e3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:48.199196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:48.199946 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:48.200195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:48.200498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] PATH_INFO: `/v3/projects/5cc73d67d3654c56ac035725d8ff0457/users/d2f4ace18877496dbc5f299a555ceaa5/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:48.219325 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc73d67d3654c56ac035725d8ff0457, user_id=d2f4ace18877496dbc5f299a555ceaa5, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:48.222093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:48.237492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1174/2341] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:34:48 2022] PUT /identity/v3/projects/5cc73d67d3654c56ac035725d8ff0457/users/d2f4ace18877496dbc5f299a555ceaa5/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:34:48.247914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a3cc-4f69-40c2-8427-f619f40753e7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:48.248414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a3cc-4f69-40c2-8427-f619f40753e7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:48.248510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a3cc-4f69-40c2-8427-f619f40753e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:48.276215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6830a3cc-4f69-40c2-8427-f619f40753e7 None None] MFA Rules not processed for user `d2f4ace18877496dbc5f299a555ceaa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:48.277472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6830a3cc-4f69-40c2-8427-f619f40753e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:48.344828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1168/2342] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:34:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:34:48.362020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:48.364950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:48.432580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f834c1-c4f7-4a07-aabb-9d5774330fe6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:48.437054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e43bff-761e-457b-bf9d-26592cd5886a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:48.437654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43bff-761e-457b-bf9d-26592cd5886a service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:48.437932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43bff-761e-457b-bf9d-26592cd5886a service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:48.438204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e43bff-761e-457b-bf9d-26592cd5886a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:48.447457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43bff-761e-457b-bf9d-26592cd5886a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:48.448925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e43bff-761e-457b-bf9d-26592cd5886a service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:48.457987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1175/2343] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:48 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:34:53.524529 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830a3cc-4f69-40c2-8427-f619f40753e7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:53.534716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:53.592066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830a3cc-4f69-40c2-8427-f619f40753e7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:53.596487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:53.597123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:53.597395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:53.597663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] PATH_INFO: `/v3/users/d2f4ace18877496dbc5f299a555ceaa5` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:53.598760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f4ace18877496dbc5f299a555ceaa5)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:53.600710 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:53.654881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f4ace18877496dbc5f299a555ceaa5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:53.668807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f4ace18877496dbc5f299a555ceaa5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:53.684076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f4ace18877496dbc5f299a555ceaa5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:53.684889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f4ace18877496dbc5f299a555ceaa5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:53.692245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f4ace18877496dbc5f299a555ceaa5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:53.698732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1169/2344] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:34:53 2022] DELETE /identity/v3/users/d2f4ace18877496dbc5f299a555ceaa5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:34:53.703806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:53.704316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:53.704484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:53.724363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:53.725621 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:53.744647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:53.788839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1176/2345] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:34:53.799125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:53.801023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:53.861845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ffe76-6d9b-482e-9c54-c7db1ea6aeda admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:53.865487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ecce0-f64c-4c8a-ae19-905e4385ce2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:53.866100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ecce0-f64c-4c8a-ae19-905e4385ce2b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:53.866376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ecce0-f64c-4c8a-ae19-905e4385ce2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:53.866642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ecce0-f64c-4c8a-ae19-905e4385ce2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:53.876420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ecce0-f64c-4c8a-ae19-905e4385ce2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:53.877869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ecce0-f64c-4c8a-ae19-905e4385ce2b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:53.888127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1170/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:34:54.251386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:54.253196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:54.268694 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5d533-8f0c-4d7a-87ee-60549abc2f10 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:54.276326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:54.276936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:54.277417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:54.277698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] PATH_INFO: `/v3/projects/5cc73d67d3654c56ac035725d8ff0457` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:54.278976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc73d67d3654c56ac035725d8ff0457)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:54.280928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:54.333374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc73d67d3654c56ac035725d8ff0457', 'request_id': 'req-63c17bdd-31b2-46a7-9938-d86bf5058405'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:54.342551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc73d67d3654c56ac035725d8ff0457', 'request_id': 'req-63c17bdd-31b2-46a7-9938-d86bf5058405'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:54.349267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc73d67d3654c56ac035725d8ff0457', 'request_id': 'req-63c17bdd-31b2-46a7-9938-d86bf5058405'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:54.360453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] The token cache is being invalidate because project 5cc73d67d3654c56ac035725d8ff0457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:34:54.360738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:54.361401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:34:54.363000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1177/2347] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:34:54 2022] DELETE /identity/v3/projects/5cc73d67d3654c56ac035725d8ff0457 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:34:56.127901 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:56.128425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:56.128554 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:56.148568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] MFA Rules not processed for user `14edcf1140f840679b671523b5c29d38`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:56.149766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:56.177489 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:56.215655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1171/2348] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:34:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:34:56.536705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:56.538576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:56.602327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c17bdd-31b2-46a7-9938-d86bf5058405 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:56.607000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:56.607671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:56.607952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:56.608220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:56.610115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:56.621222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:56.622771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:56.632586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1178/2349] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:34:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:35:00.136936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:00.138695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:00.217449 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d549d4-c3cb-42b9-aff6-37b6e3303a45 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:00.223655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:00.224232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:00.224514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:00.224783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:00.226676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:00.291415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:00.293144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:00.304132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1172/2350] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:06.629416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:08.126169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:08.140374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ff354-8a3a-4ac2-8c91-07910afeaa8c service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:08.146849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771c964-af03-4d8b-b714-0768a23c5fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:08.147480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c964-af03-4d8b-b714-0768a23c5fc6 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:08.147789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c964-af03-4d8b-b714-0768a23c5fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:08.148055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c964-af03-4d8b-b714-0768a23c5fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:08.150086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b771c964-af03-4d8b-b714-0768a23c5fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:08.163832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771c964-af03-4d8b-b714-0768a23c5fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:08.165416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771c964-af03-4d8b-b714-0768a23c5fc6 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:08.177438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1179/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:10.298594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=67 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:13.094081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:13.102261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:13.175443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f57a1-15f2-4e3c-b108-c94182e37ca4 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:13.180570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:13.181183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:13.181463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:13.181736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:13.183498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:13.196029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:13.197624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:13.208184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1173/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:18.172836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=6 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:19.689405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:19.690004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:19.690004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:19.709635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] MFA Rules not processed for user `bebd3b0bcdc04e77945fb9ddf8ca2d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:35:19.710842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:19.718887 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1180/2353] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:35:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:35:20.035955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:20.047771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f283d4-099f-4a2a-9061-6c0b6b1d8e62 service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:20.052703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:20.053300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:20.053578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:20.053872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:20.055819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:20.065906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:20.067350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:20.075898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1174/2354] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:23.072707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:23.074458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:23.093485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a7086-0313-4322-b7c5-1943b5f9e89e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:23.101414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e41ae2-e186-4e20-a134-5201164476ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:23.102037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41ae2-e186-4e20-a134-5201164476ff service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:23.102398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41ae2-e186-4e20-a134-5201164476ff service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:23.102673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e41ae2-e186-4e20-a134-5201164476ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:23.105292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-06e41ae2-e186-4e20-a134-5201164476ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:23.119406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41ae2-e186-4e20-a134-5201164476ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:23.121066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e41ae2-e186-4e20-a134-5201164476ff service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:23.155817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1181/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:30.071969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=38 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:33.128711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=9 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:42.890785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:42.906422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5113a27-4ea8-4652-a87a-e51c96402a9e service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:42.913228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:42.913898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:42.914142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:42.914417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:42.916353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:42.977545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:42.979275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:42.988570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1175/2356] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:52.484159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b590a-2ad3-4923-9e94-81791d2cde87 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:52.484743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b590a-2ad3-4923-9e94-81791d2cde87 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:52.484743 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b590a-2ad3-4923-9e94-81791d2cde87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:52.507439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6d3b590a-2ad3-4923-9e94-81791d2cde87 None None] MFA Rules not processed for user `aa1bc77ffe9245c8b1c8fa0ede1874b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:35:52.508740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6d3b590a-2ad3-4923-9e94-81791d2cde87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:52.515816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1182/2357] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:35:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:35:52.827115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:52.837634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae19310-a5ab-4e86-88c0-073f5db01edb service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:52.842042 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:52.842640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:52.842922 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:52.843177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:52.845187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:52.855153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:52.856617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:52.864603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1176/2358] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:02.499707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:02.861388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=34 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:26.572167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:26.572702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:26.572702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:26.592608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] MFA Rules not processed for user `dbd7677320d549a4bd492fa00a071f19`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:26.593837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:26.652786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1183/2359] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:36.644980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=25 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:39.399324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:39.413186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1941e-86e0-4b29-a3d7-5776463d01ca service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:39.418199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:39.418897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:39.419267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:39.419782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:39.421939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:39.492637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:39.494099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:39.505018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1177/2360] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:43.059113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:43.061386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:43.087277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0c3f-a491-4660-a423-44b8208b8929 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:43.095439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:43.096406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.096945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.097444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.100103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:43.128249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:43.130041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:43.140926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1184/2361] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:43.144056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:43.146586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:43.160438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c835c-cc7f-40e1-8b9b-e9c6cec6742c service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:43.165970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:43.166729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.167085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.167777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] PATH_INFO: `/v3/users/14edcf1140f840679b671523b5c29d38` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.168971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14edcf1140f840679b671523b5c29d38)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:43.171153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:43.225524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14edcf1140f840679b671523b5c29d38'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.242344 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14edcf1140f840679b671523b5c29d38'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.259758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14edcf1140f840679b671523b5c29d38'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.260468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14edcf1140f840679b671523b5c29d38'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.268141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14edcf1140f840679b671523b5c29d38'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.274351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1178/2362] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:43 2022] DELETE /identity/v3/users/14edcf1140f840679b671523b5c29d38 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:43.345643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:43.360469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1b987-7061-4d39-9ff8-a7681ea912dd service placement] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:43.441249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b09c9-28d3-4b02-b2b9-a12aa7ea20ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:43.441873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b09c9-28d3-4b02-b2b9-a12aa7ea20ba service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.442143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b09c9-28d3-4b02-b2b9-a12aa7ea20ba service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.442616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b09c9-28d3-4b02-b2b9-a12aa7ea20ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.444518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-7a1b09c9-28d3-4b02-b2b9-a12aa7ea20ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:43.463713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b09c9-28d3-4b02-b2b9-a12aa7ea20ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:43.465892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b09c9-28d3-4b02-b2b9-a12aa7ea20ba service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:43.479518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1185/2363] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:43.489962 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:43.491453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:43.571611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65c33b-d950-4fa0-9cad-2eb874b9b392 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:43.577070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:43.578097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.578375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.578638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] PATH_INFO: `/v3/projects/848d1c8dc86e4d019850168d36e9c282` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.580516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=848d1c8dc86e4d019850168d36e9c282)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:43.582475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:43.592539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:43.647076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848d1c8dc86e4d019850168d36e9c282', 'request_id': 'req-7513b927-9dd5-4f9d-938b-256be6c0d4c3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.652818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848d1c8dc86e4d019850168d36e9c282', 'request_id': 'req-7513b927-9dd5-4f9d-938b-256be6c0d4c3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.660917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848d1c8dc86e4d019850168d36e9c282', 'request_id': 'req-7513b927-9dd5-4f9d-938b-256be6c0d4c3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.677342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] The token cache is being invalidate because project 848d1c8dc86e4d019850168d36e9c282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:36:43.677686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.678351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-7513b927-9dd5-4f9d-938b-256be6c0d4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:43.687624 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1179/2364] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:36:43 2022] DELETE /identity/v3/projects/848d1c8dc86e4d019850168d36e9c282 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:43.690286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6a66-69a7-453f-8c0f-5770c49648d9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.690575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6a66-69a7-453f-8c0f-5770c49648d9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.690844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c6a66-69a7-453f-8c0f-5770c49648d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.711763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-581c6a66-69a7-453f-8c0f-5770c49648d9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:43.713076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-581c6a66-69a7-453f-8c0f-5770c49648d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:43.781080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1186/2365] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:43.789504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf92af-f350-4639-8923-04a5f362b60c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.789773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf92af-f350-4639-8923-04a5f362b60c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.790040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf92af-f350-4639-8923-04a5f362b60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.812417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fddf92af-f350-4639-8923-04a5f362b60c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:43.813913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fddf92af-f350-4639-8923-04a5f362b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:43.824617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1180/2366] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:43.828886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6a66-69a7-453f-8c0f-5770c49648d9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:43.841156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c6a66-69a7-453f-8c0f-5770c49648d9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:43.846346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:43.847213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.847576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.847937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.848674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:36:43.849047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:43.850728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:43.864309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1187/2367] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:36:43.868802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf92af-f350-4639-8923-04a5f362b60c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:43.878600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf92af-f350-4639-8923-04a5f362b60c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:43.884289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:43.885097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:43.886059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:43.886339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:43.886987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:43.889942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:43.925317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1181/2368] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:36:43 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:43.929725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:43.940648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5ce6-f87f-4038-8384-2ffb38110781 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:43.999983 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.000605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.000917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.001194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.001852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.003940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.013115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:44.036109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1188/2369] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:36:43 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:44.037553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.050069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3fb00-89a0-4d12-85c5-96940504ee3c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.056171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.056879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.057225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.057561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.058276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.060002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.070822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1182/2370] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:44.074816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.087004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909ccbd-8260-4fd2-872b-c13e1a8a2cfb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.092605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f97e0-88d8-4231-ae10-38e348f2f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.093232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f97e0-88d8-4231-ae10-38e348f2f437 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.093513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f97e0-88d8-4231-ae10-38e348f2f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.093849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f97e0-88d8-4231-ae10-38e348f2f437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.094501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f97e0-88d8-4231-ae10-38e348f2f437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.096241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f97e0-88d8-4231-ae10-38e348f2f437 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.107757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1189/2371] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:44.111991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.125785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16780ab-86d7-4c72-92fa-0db220055280 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.132334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.133271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.133390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.134094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] PATH_INFO: `/v3/projects/e03292a70d9f4986a84753714ce568cb/users/f0e4ce8e63084b418c48a57f2576f86b/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.152141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e03292a70d9f4986a84753714ce568cb, user_id=f0e4ce8e63084b418c48a57f2576f86b, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.154501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.173423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1183/2372] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:44 2022] PUT /identity/v3/projects/e03292a70d9f4986a84753714ce568cb/users/f0e4ce8e63084b418c48a57f2576f86b/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:44.185484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d05e-6bd1-4cf1-95bd-4ce4cd2fc0f1 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.186272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d05e-6bd1-4cf1-95bd-4ce4cd2fc0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.186687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d05e-6bd1-4cf1-95bd-4ce4cd2fc0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.221281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5b29d05e-6bd1-4cf1-95bd-4ce4cd2fc0f1 None None] MFA Rules not processed for user `f0e4ce8e63084b418c48a57f2576f86b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:44.222811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5b29d05e-6bd1-4cf1-95bd-4ce4cd2fc0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:44.301926 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1190/2373] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:44.302911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.367600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279fe70-2d7f-4ac9-959e-05fc147a2c00 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.372130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.372797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.373053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.373322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.373957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.376052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.406205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1184/2374] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:36:44 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:44.410505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29d05e-6bd1-4cf1-95bd-4ce4cd2fc0f1 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.422274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29d05e-6bd1-4cf1-95bd-4ce4cd2fc0f1 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.486897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.487521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.487829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.488099 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.488736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.490742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.516024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1191/2375] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:36:44 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:44.517562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.529342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e3ee3-ce32-4fc1-9f11-be2d7aae7422 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.534793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.535398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.535716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.535988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.536671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.538313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.550541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1185/2376] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:44.554765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.565686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93dd0e-9b32-47b1-bd59-8c91de20d906 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.570906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.571569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.571885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.572156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] PATH_INFO: `/v3/projects/4291f5baaab74278a175fc615ab59a71/users/28ca8c2b752d4053abd1e422155ac4ff/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.588129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4291f5baaab74278a175fc615ab59a71, user_id=28ca8c2b752d4053abd1e422155ac4ff, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.590901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.605852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1192/2377] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:44 2022] PUT /identity/v3/projects/4291f5baaab74278a175fc615ab59a71/users/28ca8c2b752d4053abd1e422155ac4ff/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:36:44.610104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.620570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb2b3e-4ff6-47fb-9c17-649776473420 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.624198 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:44.684795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cdbef-20eb-408a-ac42-4beaf095f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.685411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cdbef-20eb-408a-ac42-4beaf095f16c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.685689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cdbef-20eb-408a-ac42-4beaf095f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.685986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cdbef-20eb-408a-ac42-4beaf095f16c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.686625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cdbef-20eb-408a-ac42-4beaf095f16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.688294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cdbef-20eb-408a-ac42-4beaf095f16c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.698914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1186/2378] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:44.703407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.714465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b3e61-aafa-4150-a274-c0c0636fca06 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.719320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.720084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.720538 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.720822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] PATH_INFO: `/v3/projects/4291f5baaab74278a175fc615ab59a71/users/28ca8c2b752d4053abd1e422155ac4ff/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.722794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4291f5baaab74278a175fc615ab59a71, user_id=28ca8c2b752d4053abd1e422155ac4ff, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.725480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.736381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1193/2379] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:44 2022] PUT /identity/v3/projects/4291f5baaab74278a175fc615ab59a71/users/28ca8c2b752d4053abd1e422155ac4ff/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:44.747496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ac41-eee6-420c-92cf-136dff0a4b0f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.748020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ac41-eee6-420c-92cf-136dff0a4b0f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.748526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ac41-eee6-420c-92cf-136dff0a4b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.786560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ea71ac41-eee6-420c-92cf-136dff0a4b0f None None] MFA Rules not processed for user `28ca8c2b752d4053abd1e422155ac4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:44.787938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ea71ac41-eee6-420c-92cf-136dff0a4b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:44.862765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1187/2380] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:44.875375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:44.878389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:44.906766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:44.945456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1b8c4-86ee-488a-84ec-9935e852e652 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:44.949163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9f1a-3254-4f6d-a81b-99cf7a25bf75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:44.949768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9f1a-3254-4f6d-a81b-99cf7a25bf75 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:44.950039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9f1a-3254-4f6d-a81b-99cf7a25bf75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:44.950305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9f1a-3254-4f6d-a81b-99cf7a25bf75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:44.960072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c9f1a-3254-4f6d-a81b-99cf7a25bf75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:44.961493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c9f1a-3254-4f6d-a81b-99cf7a25bf75 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:44.971253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1194/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:45.390223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ac41-eee6-420c-92cf-136dff0a4b0f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:45.456413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ac41-eee6-420c-92cf-136dff0a4b0f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:45.461218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:45.461850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:45.462128 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:45.462397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] PATH_INFO: `/v3/users/f0e4ce8e63084b418c48a57f2576f86b` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:45.463535 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e4ce8e63084b418c48a57f2576f86b)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:45.465526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:45.503631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:45.519936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e4ce8e63084b418c48a57f2576f86b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:45.530474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e4ce8e63084b418c48a57f2576f86b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:45.542539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e4ce8e63084b418c48a57f2576f86b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:45.543175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e4ce8e63084b418c48a57f2576f86b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:45.550405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e4ce8e63084b418c48a57f2576f86b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:45.556201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1188/2382] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:45 2022] DELETE /identity/v3/users/f0e4ce8e63084b418c48a57f2576f86b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:45.560825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:45.561316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:45.561413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:45.581487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:45.582705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:45.651494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1195/2383] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:36:45.662696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:45.664281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:45.725386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fceeb8-39b9-4238-a70f-fd52fd4c4cb6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:45.730049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:45.730664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:45.730942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:45.731209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:45.741992 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:45.743423 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:45.753065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1189/2384] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:46.038316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:46.039827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:46.055349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ea912-7c5e-4a67-9f95-62afdd8b40a3 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:46.062427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:46.063105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.063219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.063802 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] PATH_INFO: `/v3/projects/e03292a70d9f4986a84753714ce568cb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.065536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e03292a70d9f4986a84753714ce568cb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:46.067402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:46.118947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e03292a70d9f4986a84753714ce568cb', 'request_id': 'req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.129775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e03292a70d9f4986a84753714ce568cb', 'request_id': 'req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.139835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e03292a70d9f4986a84753714ce568cb', 'request_id': 'req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.152290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] The token cache is being invalidate because project e03292a70d9f4986a84753714ce568cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:36:46.152584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.153268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.154824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1196/2385] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:36:46 2022] DELETE /identity/v3/projects/e03292a70d9f4986a84753714ce568cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:46.159341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:46.169220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786fb6-c322-437a-8b60-8f057c1f62b0 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:46.228350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:46.228987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.229267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.229540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] PATH_INFO: `/v3/users/28ca8c2b752d4053abd1e422155ac4ff` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.230691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ca8c2b752d4053abd1e422155ac4ff)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:46.232669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:46.288526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ca8c2b752d4053abd1e422155ac4ff'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.292208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:46.300707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ca8c2b752d4053abd1e422155ac4ff'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.314439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ca8c2b752d4053abd1e422155ac4ff'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.315095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ca8c2b752d4053abd1e422155ac4ff'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.322265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb919a98-710a-48e6-90d9-d5801efc31b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ca8c2b752d4053abd1e422155ac4ff'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.328417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1190/2386] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:46 2022] DELETE /identity/v3/users/28ca8c2b752d4053abd1e422155ac4ff => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:46.618929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:46.620474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:46.635859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acf377-0e8e-45c2-9f35-faa4bda10b5e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:46.682489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:46.697200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:46.697838 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.698115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.698385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] PATH_INFO: `/v3/projects/4291f5baaab74278a175fc615ab59a71` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.699497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4291f5baaab74278a175fc615ab59a71)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:46.701436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:46.752304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4291f5baaab74278a175fc615ab59a71', 'request_id': 'req-038e352b-7400-4fdb-859c-2711dbbb9509'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.761762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4291f5baaab74278a175fc615ab59a71', 'request_id': 'req-038e352b-7400-4fdb-859c-2711dbbb9509'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.768797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4291f5baaab74278a175fc615ab59a71', 'request_id': 'req-038e352b-7400-4fdb-859c-2711dbbb9509'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.779530 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] The token cache is being invalidate because project 4291f5baaab74278a175fc615ab59a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:36:46.779841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.780502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-038e352b-7400-4fdb-859c-2711dbbb9509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:46.781991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1197/2387] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:36:46 2022] DELETE /identity/v3/projects/4291f5baaab74278a175fc615ab59a71 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:36:46.787328 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028d9a-19a6-4f8a-958f-99b44ef450be None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.787865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028d9a-19a6-4f8a-958f-99b44ef450be None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.788083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e028d9a-19a6-4f8a-958f-99b44ef450be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.814625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3e028d9a-19a6-4f8a-958f-99b44ef450be None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:46.816459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3e028d9a-19a6-4f8a-958f-99b44ef450be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:46.884614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1191/2388] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:46.893398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cac286-6ab4-4c73-a4d6-5f17b6dcbe1d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.893711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cac286-6ab4-4c73-a4d6-5f17b6dcbe1d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.894007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cac286-6ab4-4c73-a4d6-5f17b6dcbe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.916529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-86cac286-6ab4-4c73-a4d6-5f17b6dcbe1d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:46.917753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-86cac286-6ab4-4c73-a4d6-5f17b6dcbe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:46.928112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1198/2389] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:46.932568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e028d9a-19a6-4f8a-958f-99b44ef450be None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:46.945309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e028d9a-19a6-4f8a-958f-99b44ef450be None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:46.953837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:46.954760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.955072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.955296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.955984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:36:46.956288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:46.957907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:46.970549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1192/2390] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:36:46.975210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cac286-6ab4-4c73-a4d6-5f17b6dcbe1d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:46.985013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cac286-6ab4-4c73-a4d6-5f17b6dcbe1d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:46.990591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:46.991195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.991467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.991769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.992396 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:46.994277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.024569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1199/2391] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:36:46 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:47.028917 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.039780 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fa265-b331-4ac5-b694-4d99c1f02715 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.098436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.099045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.099324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.099631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.100263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.102203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.126159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1193/2392] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:36:47 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:47.130533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.141087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68430497-62ee-4626-bccc-f704bd285443 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.146536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.147138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.147526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.147828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.148467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.150052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.160642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1200/2393] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:36:47.164707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.175579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465209-9fe1-49f0-829b-5e0373ca29bf admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.180508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac9ee7-9d13-4db8-8e10-1554c751de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.181125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9ee7-9d13-4db8-8e10-1554c751de15 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.181407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9ee7-9d13-4db8-8e10-1554c751de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.181678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac9ee7-9d13-4db8-8e10-1554c751de15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.182325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac9ee7-9d13-4db8-8e10-1554c751de15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.183964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac9ee7-9d13-4db8-8e10-1554c751de15 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.194986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1194/2394] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:47.201359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.211642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299ea00-0464-4bbb-9e98-1d4000dc5f86 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.216808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.217470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.217753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.218053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] PATH_INFO: `/v3/projects/8b4ca353b56b4da9bfb78c2135d96819/users/166f0818cb0c4adeb99339b4a071f02a/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.234349 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4ca353b56b4da9bfb78c2135d96819, user_id=166f0818cb0c4adeb99339b4a071f02a, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.237365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.253882 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1201/2395] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:47 2022] PUT /identity/v3/projects/8b4ca353b56b4da9bfb78c2135d96819/users/166f0818cb0c4adeb99339b4a071f02a/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:36:47.264563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a1e4e-bc87-4863-b4cc-2e45fbbc47f4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.264842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a1e4e-bc87-4863-b4cc-2e45fbbc47f4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.265119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a1e4e-bc87-4863-b4cc-2e45fbbc47f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.294601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e04a1e4e-bc87-4863-b4cc-2e45fbbc47f4 None None] MFA Rules not processed for user `166f0818cb0c4adeb99339b4a071f02a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:47.295846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e04a1e4e-bc87-4863-b4cc-2e45fbbc47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:47.325118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:47.366194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1195/2396] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:47.370801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.434870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb3794-ce2d-4f0c-8a3c-77488490d3d8 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.440291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.440897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.441168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.441436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.442078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.444019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.467996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:47.477423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1202/2397] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:36:47 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:36:47.481558 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a1e4e-bc87-4863-b4cc-2e45fbbc47f4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.492456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a1e4e-bc87-4863-b4cc-2e45fbbc47f4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.559151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.559802 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.560080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.560339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.560995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.562943 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.589557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1196/2398] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:36:47 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:47.590886 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.601967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab8e03-c3a1-43db-9b28-01df82fe7c76 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.607159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.607790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.608066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.608333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.608966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.610563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.622481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1203/2399] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:47.628013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.643679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e682a-5901-4d9d-b990-04a861936603 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.649497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.650152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.650429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.650701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] PATH_INFO: `/v3/projects/aae7b44b81244ded9cae7ed9af6169f1/users/68aa0302760841e49e358cea66e7fb8f/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.667451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae7b44b81244ded9cae7ed9af6169f1, user_id=68aa0302760841e49e358cea66e7fb8f, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.670271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.691054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1197/2400] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:47 2022] PUT /identity/v3/projects/aae7b44b81244ded9cae7ed9af6169f1/users/68aa0302760841e49e358cea66e7fb8f/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:47.697444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.711453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091f05-e5fd-4e18-b4d1-f7183536ec8b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.773404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f608a5-e49b-440e-aea2-e5603fc293f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.774007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f608a5-e49b-440e-aea2-e5603fc293f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.774270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f608a5-e49b-440e-aea2-e5603fc293f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.774535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f608a5-e49b-440e-aea2-e5603fc293f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.775177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f608a5-e49b-440e-aea2-e5603fc293f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.776812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f608a5-e49b-440e-aea2-e5603fc293f1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.786583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1204/2401] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:47.792536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.806061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b96-11f3-4e51-a0bc-7b2e9754b206 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:47.814606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:47.815672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.816092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.816438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] PATH_INFO: `/v3/projects/aae7b44b81244ded9cae7ed9af6169f1/users/68aa0302760841e49e358cea66e7fb8f/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.818852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aae7b44b81244ded9cae7ed9af6169f1, user_id=68aa0302760841e49e358cea66e7fb8f, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:47.821573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:47.834562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1198/2402] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:47 2022] PUT /identity/v3/projects/aae7b44b81244ded9cae7ed9af6169f1/users/68aa0302760841e49e358cea66e7fb8f/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:47.849489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ae563-1bf1-48f1-91c5-e719c473f8ee None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:47.849851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ae563-1bf1-48f1-91c5-e719c473f8ee None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:47.850195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ae563-1bf1-48f1-91c5-e719c473f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:47.880065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ce1ae563-1bf1-48f1-91c5-e719c473f8ee None None] MFA Rules not processed for user `68aa0302760841e49e358cea66e7fb8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:47.881284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ce1ae563-1bf1-48f1-91c5-e719c473f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:47.954594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1205/2403] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:47.966109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:47.968009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:48.027665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021fed7-d1d5-4e4e-9eec-f692ea4cc0e8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:48.031569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035bcdc-de34-4202-a547-1950981234f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:48.032172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035bcdc-de34-4202-a547-1950981234f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:48.032447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035bcdc-de34-4202-a547-1950981234f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:48.032693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035bcdc-de34-4202-a547-1950981234f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:48.043109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035bcdc-de34-4202-a547-1950981234f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:48.044557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035bcdc-de34-4202-a547-1950981234f8 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:48.054468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1199/2404] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:48.084145 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ae563-1bf1-48f1-91c5-e719c473f8ee None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:48.148449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ae563-1bf1-48f1-91c5-e719c473f8ee None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:48.153245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:48.153875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:48.154141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:48.154421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] PATH_INFO: `/v3/users/166f0818cb0c4adeb99339b4a071f02a` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:48.155637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166f0818cb0c4adeb99339b4a071f02a)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:48.157549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:48.168975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:48.211833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166f0818cb0c4adeb99339b4a071f02a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.220988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166f0818cb0c4adeb99339b4a071f02a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.221824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166f0818cb0c4adeb99339b4a071f02a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.229106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166f0818cb0c4adeb99339b4a071f02a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.241722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166f0818cb0c4adeb99339b4a071f02a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.247551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1206/2405] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:48 2022] DELETE /identity/v3/users/166f0818cb0c4adeb99339b4a071f02a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:48.252238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:48.252527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:48.252805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:48.273808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:48.275066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:48.290625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:48.354816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1200/2406] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:48.367986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:48.369821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:48.430968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f23547-084a-4625-ab7e-f0701e4eb088 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:48.435640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:48.436235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:48.436500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:48.436764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:48.447293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:48.448766 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:48.458760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1207/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:48.741541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:48.742990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:48.756492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6400f-bf8a-4eaa-981b-525cdad48903 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:48.762270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:48.762949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:48.763225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:48.763501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] PATH_INFO: `/v3/projects/8b4ca353b56b4da9bfb78c2135d96819` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:48.764803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4ca353b56b4da9bfb78c2135d96819)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:48.766757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:48.817986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4ca353b56b4da9bfb78c2135d96819', 'request_id': 'req-2ea21a14-f76d-4113-a008-dddb35ea5d41'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.823843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4ca353b56b4da9bfb78c2135d96819', 'request_id': 'req-2ea21a14-f76d-4113-a008-dddb35ea5d41'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.830388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4ca353b56b4da9bfb78c2135d96819', 'request_id': 'req-2ea21a14-f76d-4113-a008-dddb35ea5d41'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.845658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] The token cache is being invalidate because project 8b4ca353b56b4da9bfb78c2135d96819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:36:48.845947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.846653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.848232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1201/2408] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:36:48 2022] DELETE /identity/v3/projects/8b4ca353b56b4da9bfb78c2135d96819 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:48.852593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:48.862654 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5fffa-7868-4819-a1c0-3f51401b7481 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:48.922714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:48.923378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:48.923686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:48.923981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] PATH_INFO: `/v3/users/68aa0302760841e49e358cea66e7fb8f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:48.925269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68aa0302760841e49e358cea66e7fb8f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:48.927209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:48.966018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:48.979844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68aa0302760841e49e358cea66e7fb8f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.989954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68aa0302760841e49e358cea66e7fb8f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.990614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68aa0302760841e49e358cea66e7fb8f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:48.997980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68aa0302760841e49e358cea66e7fb8f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:49.010718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9eeda8f4-77ce-427a-9db0-5c5ca6b3b754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68aa0302760841e49e358cea66e7fb8f'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:49.017108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1208/2409] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:48 2022] DELETE /identity/v3/users/68aa0302760841e49e358cea66e7fb8f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:49.311104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:49.312817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:49.328341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21a14-f76d-4113-a008-dddb35ea5d41 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:49.390235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:49.390866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.391145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.391420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] PATH_INFO: `/v3/projects/aae7b44b81244ded9cae7ed9af6169f1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.392544 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aae7b44b81244ded9cae7ed9af6169f1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:49.394539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:49.441521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:49.444798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aae7b44b81244ded9cae7ed9af6169f1', 'request_id': 'req-e5e67a4b-f27d-49bd-b469-6f7887f28483'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:49.451494 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aae7b44b81244ded9cae7ed9af6169f1', 'request_id': 'req-e5e67a4b-f27d-49bd-b469-6f7887f28483'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:49.458499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aae7b44b81244ded9cae7ed9af6169f1', 'request_id': 'req-e5e67a4b-f27d-49bd-b469-6f7887f28483'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:49.473184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] The token cache is being invalidate because project aae7b44b81244ded9cae7ed9af6169f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:36:49.473468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:49.474085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e5e67a4b-f27d-49bd-b469-6f7887f28483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:49.475604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1202/2410] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:36:49 2022] DELETE /identity/v3/projects/aae7b44b81244ded9cae7ed9af6169f1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:49.480725 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e82c4-0f32-4787-aff5-b41b0acced9a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.481013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e82c4-0f32-4787-aff5-b41b0acced9a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.481293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e82c4-0f32-4787-aff5-b41b0acced9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.501747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b52e82c4-0f32-4787-aff5-b41b0acced9a None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:49.502943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b52e82c4-0f32-4787-aff5-b41b0acced9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:49.566659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1209/2411] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:49.575884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c661b-ab34-41cd-879a-1a8f2f78be16 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.576161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c661b-ab34-41cd-879a-1a8f2f78be16 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.576421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c661b-ab34-41cd-879a-1a8f2f78be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.596968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-700c661b-ab34-41cd-879a-1a8f2f78be16 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:49.598294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-700c661b-ab34-41cd-879a-1a8f2f78be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:49.606925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1203/2412] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:49.611458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e82c4-0f32-4787-aff5-b41b0acced9a None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:49.621496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e82c4-0f32-4787-aff5-b41b0acced9a None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:49.626485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:49.627086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.627359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.627657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.628366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:36:49.628665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:49.630267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:49.641986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1210/2413] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:36:49.646840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c661b-ab34-41cd-879a-1a8f2f78be16 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:49.658156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c661b-ab34-41cd-879a-1a8f2f78be16 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:49.663566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:49.664187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.664468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.664740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.665386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:49.667351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:49.698115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1204/2414] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:36:49 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:49.702582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:49.713177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c89d7-64d8-41f2-bcc4-5c1adad3bb53 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:49.771640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:49.772198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.772474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.772736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.773378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:49.775289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:49.799637 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1211/2415] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:36:49 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:49.804037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:49.815023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0450bbd-b5f9-4ea7-835c-7846f4b41c0d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:49.820275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:49.820893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.821179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.821433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.822216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:49.823839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:49.834228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1205/2416] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:49.840455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:49.856611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a098a-84ff-4914-8e3d-22f1422732cb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:49.862676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45579880-e659-4329-935c-ace632de5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:49.863313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579880-e659-4329-935c-ace632de5eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.863605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579880-e659-4329-935c-ace632de5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.863889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45579880-e659-4329-935c-ace632de5eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.864533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45579880-e659-4329-935c-ace632de5eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:49.866170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45579880-e659-4329-935c-ace632de5eb1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:49.877362 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1212/2417] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:49.881960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:49.892663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf6081-d06c-4ba9-92a9-e157e68021a1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:49.898817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:49.899490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.899781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.900057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] PATH_INFO: `/v3/projects/ff2a63742f55497e9b3495ca45ed6d9d/users/f594440490104effa54f082c7dde4732/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.916577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2a63742f55497e9b3495ca45ed6d9d, user_id=f594440490104effa54f082c7dde4732, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:49.919251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:49.937160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1206/2418] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:49 2022] PUT /identity/v3/projects/ff2a63742f55497e9b3495ca45ed6d9d/users/f594440490104effa54f082c7dde4732/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:49.948370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05da0fe-8abd-4c1b-9627-a5de93f542fa None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:49.948642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05da0fe-8abd-4c1b-9627-a5de93f542fa None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:49.948913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05da0fe-8abd-4c1b-9627-a5de93f542fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:49.977799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b05da0fe-8abd-4c1b-9627-a5de93f542fa None None] MFA Rules not processed for user `f594440490104effa54f082c7dde4732`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:49.979012 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b05da0fe-8abd-4c1b-9627-a5de93f542fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:49.983277 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:50.045894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1213/2419] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:50.051367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.118933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88d57-0e71-4178-bb1a-b3bba49667b4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.124450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.125065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.125348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.125620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.126258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.128387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.158406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1207/2420] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:36:50 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:50.163671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05da0fe-8abd-4c1b-9627-a5de93f542fa None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.180323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05da0fe-8abd-4c1b-9627-a5de93f542fa None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.243288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.243934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.244209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.244484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.245127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.247063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.271234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1214/2421] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:36:50 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:50.275478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.286217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794e16c-def9-455f-9377-06a4e151efd5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.291537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.292183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.292459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.292722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.293352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.294968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.309122 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1208/2422] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:50.313410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.323425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a20fe-d045-432b-9f2e-eddecc3445f1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.328684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a33dc1-31a1-4df8-846b-b4f7366b2c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.329299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33dc1-31a1-4df8-846b-b4f7366b2c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.329574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33dc1-31a1-4df8-846b-b4f7366b2c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.329841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a33dc1-31a1-4df8-846b-b4f7366b2c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.330490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a33dc1-31a1-4df8-846b-b4f7366b2c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.332720 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a33dc1-31a1-4df8-846b-b4f7366b2c49 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.348392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1215/2423] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:50.354396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.365190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f6e4f-cf5e-4ba4-bc2a-44a84806cdee admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.371152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.371873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.372147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.372414 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] PATH_INFO: `/v3/projects/5a3af12597a94cd28a93f4446bca6372/users/6995d6bb88434786ac2468447a45d6f2/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.388228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3af12597a94cd28a93f4446bca6372, user_id=6995d6bb88434786ac2468447a45d6f2, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.390883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.406799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1209/2424] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:50 2022] PUT /identity/v3/projects/5a3af12597a94cd28a93f4446bca6372/users/6995d6bb88434786ac2468447a45d6f2/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:50.418139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58715-c4db-4fa5-94b1-d21d7592ff48 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.418491 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58715-c4db-4fa5-94b1-d21d7592ff48 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.418831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58715-c4db-4fa5-94b1-d21d7592ff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.452088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b0e58715-c4db-4fa5-94b1-d21d7592ff48 None None] MFA Rules not processed for user `6995d6bb88434786ac2468447a45d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:50.453297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b0e58715-c4db-4fa5-94b1-d21d7592ff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:50.520558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1216/2425] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:50.525222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.547202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:50.590911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690bff4-d69c-4f36-8301-14dc4ccc1968 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.595716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.596327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.596603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.596958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.597586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.599481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.629438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1210/2426] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:36:50 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:50.633711 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58715-c4db-4fa5-94b1-d21d7592ff48 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.645331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58715-c4db-4fa5-94b1-d21d7592ff48 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.654401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:50.707939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.708550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.708843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.709110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.709764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.711957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.735256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1217/2427] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:36:50 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:36:50.739521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.750030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a8e7e-0892-4d61-aa65-d3f66eed7042 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.755188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.755912 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.756190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.756461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.757100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.758716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.770620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1211/2428] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:36:50.776754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.790978 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab29d-6f50-4dea-91e5-7cba9373737a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.797205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.798194 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.798468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.798734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] PATH_INFO: `/v3/projects/a09d9c86c302401091d72d0ce87eefb2/users/232f4b52a7a2475385a5dc964da67ecc/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.816297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09d9c86c302401091d72d0ce87eefb2, user_id=232f4b52a7a2475385a5dc964da67ecc, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.818984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.837257 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1218/2429] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:50 2022] PUT /identity/v3/projects/a09d9c86c302401091d72d0ce87eefb2/users/232f4b52a7a2475385a5dc964da67ecc/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:50.841396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.852161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e57e-577e-4493-a49e-2a0bbe01ad22 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.917498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8235c-7d8e-4dd7-8aea-a3601f384aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.918107 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8235c-7d8e-4dd7-8aea-a3601f384aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.918388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8235c-7d8e-4dd7-8aea-a3601f384aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.918659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8235c-7d8e-4dd7-8aea-a3601f384aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.919297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8235c-7d8e-4dd7-8aea-a3601f384aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.920944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8235c-7d8e-4dd7-8aea-a3601f384aaf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.931493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1212/2430] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:36:50.936537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:50.949043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b37edf-2adb-4a2c-bef3-da67d9818c7b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:50.954464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799354d-3486-4584-892d-322c431e745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:50.955110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799354d-3486-4584-892d-322c431e745e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.955382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799354d-3486-4584-892d-322c431e745e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.955651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799354d-3486-4584-892d-322c431e745e admin admin] PATH_INFO: `/v3/projects/a09d9c86c302401091d72d0ce87eefb2/users/232f4b52a7a2475385a5dc964da67ecc/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.957767 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799354d-3486-4584-892d-322c431e745e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09d9c86c302401091d72d0ce87eefb2, user_id=232f4b52a7a2475385a5dc964da67ecc, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:50.960446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799354d-3486-4584-892d-322c431e745e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:50.971385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1219/2431] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:36:50 2022] PUT /identity/v3/projects/a09d9c86c302401091d72d0ce87eefb2/users/232f4b52a7a2475385a5dc964da67ecc/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:50.983178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.983448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.983839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:51.018022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] MFA Rules not processed for user `232f4b52a7a2475385a5dc964da67ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:51.019283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:51.089323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1213/2432] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:51.100540 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799354d-3486-4584-892d-322c431e745e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:51.102577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9799354d-3486-4584-892d-322c431e745e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:51.162669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799354d-3486-4584-892d-322c431e745e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:51.166988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:51.167575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:51.167896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:51.168158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:51.178339 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:51.179816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:51.189121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1220/2433] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:51.708951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:51.710499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:51.723092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79425c3-035b-4bfb-b80d-98c58214bde0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:51.727787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:51.728386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:51.728725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:51.729000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:51.743003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:51.790669 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:51.792138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:51.801475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1214/2434] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:55.901360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:55.910598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69235f4-ee82-45cc-95fb-24888306ec80 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:55.914406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bc5c3-f519-4fee-854b-f14dd5d14f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:55.914997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc5c3-f519-4fee-854b-f14dd5d14f51 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:55.915268 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc5c3-f519-4fee-854b-f14dd5d14f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:55.915537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bc5c3-f519-4fee-854b-f14dd5d14f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:55.973399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bc5c3-f519-4fee-854b-f14dd5d14f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:55.974768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bc5c3-f519-4fee-854b-f14dd5d14f51 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:55.984009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1221/2435] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:58.168915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:58.243927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34c125-9b33-4ffa-9a55-a27af5399605 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:58.249088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:58.249716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:58.249995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:58.250273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] PATH_INFO: `/v3/users/f594440490104effa54f082c7dde4732` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:58.251454 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f594440490104effa54f082c7dde4732)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:58.253433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:58.304949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f594440490104effa54f082c7dde4732'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.313649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f594440490104effa54f082c7dde4732'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.330998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f594440490104effa54f082c7dde4732'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.332047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f594440490104effa54f082c7dde4732'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.339953 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f594440490104effa54f082c7dde4732'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.346101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1215/2436] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:58 2022] DELETE /identity/v3/users/f594440490104effa54f082c7dde4732 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:58.353037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:58.353557 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:58.353661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:58.371233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:58.377702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:58.379670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:58.441434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1222/2437] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:58.451436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:58.452915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:58.491601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:58.522315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de13a-0aa5-412a-a732-45ef377b681b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:58.526708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:58.527337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:58.527650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:58.527925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:58.537858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:58.539289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:58.549898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1216/2438] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:58.819824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:58.821411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:58.834072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54601e8-3d79-45fd-b112-c5d01b5ee882 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:58.846153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:58.847038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:58.847449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:58.847811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] PATH_INFO: `/v3/projects/ff2a63742f55497e9b3495ca45ed6d9d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:58.849614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2a63742f55497e9b3495ca45ed6d9d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:58.851671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:58.903695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2a63742f55497e9b3495ca45ed6d9d', 'request_id': 'req-4a7627d1-e882-4996-82d0-53bfcfa4d897'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.912582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2a63742f55497e9b3495ca45ed6d9d', 'request_id': 'req-4a7627d1-e882-4996-82d0-53bfcfa4d897'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.919022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2a63742f55497e9b3495ca45ed6d9d', 'request_id': 'req-4a7627d1-e882-4996-82d0-53bfcfa4d897'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.930419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] The token cache is being invalidate because project ff2a63742f55497e9b3495ca45ed6d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:36:58.930758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.931568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:58.933284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1223/2439] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:36:58 2022] DELETE /identity/v3/projects/ff2a63742f55497e9b3495ca45ed6d9d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:58.937432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:58.947787 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bfe83-6b11-476e-a721-f14c4ac9c4dd service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:59.008564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:59.009132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.009406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.009675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] PATH_INFO: `/v3/users/6995d6bb88434786ac2468447a45d6f2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.010850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6995d6bb88434786ac2468447a45d6f2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:59.012789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:59.067004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6995d6bb88434786ac2468447a45d6f2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.076837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6995d6bb88434786ac2468447a45d6f2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.089644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6995d6bb88434786ac2468447a45d6f2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.090330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6995d6bb88434786ac2468447a45d6f2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.097233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6995d6bb88434786ac2468447a45d6f2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.103658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1217/2440] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:58 2022] DELETE /identity/v3/users/6995d6bb88434786ac2468447a45d6f2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:59.381412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:59.382899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:59.396405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7627d1-e882-4996-82d0-53bfcfa4d897 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:59.454873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:59.455522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.455830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.456098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] PATH_INFO: `/v3/projects/5a3af12597a94cd28a93f4446bca6372` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.457271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3af12597a94cd28a93f4446bca6372)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:59.459291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:59.496280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:59.509763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3af12597a94cd28a93f4446bca6372', 'request_id': 'req-63868757-8cda-4d33-b457-b88a804fb0a2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.517685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3af12597a94cd28a93f4446bca6372', 'request_id': 'req-63868757-8cda-4d33-b457-b88a804fb0a2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.524167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3af12597a94cd28a93f4446bca6372', 'request_id': 'req-63868757-8cda-4d33-b457-b88a804fb0a2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.534395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] The token cache is being invalidate because project 5a3af12597a94cd28a93f4446bca6372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:36:59.534680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.535428 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.537198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1224/2441] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:36:59 2022] DELETE /identity/v3/projects/5a3af12597a94cd28a93f4446bca6372 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:36:59.541552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:59.543087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:59.558984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e757c39a-68e2-4c20-b30e-fcb2257c74d1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:59.622026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:59.631769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:59.632540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.632835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.633121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] PATH_INFO: `/v3/users/232f4b52a7a2475385a5dc964da67ecc` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.634598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] RBAC: Authorizing `identity:delete_user(user_id=232f4b52a7a2475385a5dc964da67ecc)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:59.636735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:59.684940 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232f4b52a7a2475385a5dc964da67ecc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.694183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232f4b52a7a2475385a5dc964da67ecc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.709176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232f4b52a7a2475385a5dc964da67ecc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.710390 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232f4b52a7a2475385a5dc964da67ecc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.720920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ff3625df-49ba-443b-827e-1ca89309279f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232f4b52a7a2475385a5dc964da67ecc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:36:59.728218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1218/2442] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:36:59 2022] DELETE /identity/v3/users/232f4b52a7a2475385a5dc964da67ecc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:00.011508 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.013247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.027033 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63868757-8cda-4d33-b457-b88a804fb0a2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.100898 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.101607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.101959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.102285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] PATH_INFO: `/v3/projects/a09d9c86c302401091d72d0ce87eefb2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.104082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09d9c86c302401091d72d0ce87eefb2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.106846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.161298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09d9c86c302401091d72d0ce87eefb2', 'request_id': 'req-412603f9-db80-484d-8b09-b65c36d9b5d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:00.171191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09d9c86c302401091d72d0ce87eefb2', 'request_id': 'req-412603f9-db80-484d-8b09-b65c36d9b5d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:00.178681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09d9c86c302401091d72d0ce87eefb2', 'request_id': 'req-412603f9-db80-484d-8b09-b65c36d9b5d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:00.189962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] The token cache is being invalidate because project a09d9c86c302401091d72d0ce87eefb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:00.190254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:00.190921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-412603f9-db80-484d-8b09-b65c36d9b5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:00.192518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1225/2443] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:00 2022] DELETE /identity/v3/projects/a09d9c86c302401091d72d0ce87eefb2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:00.198875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e508e-d024-4358-a42c-65e31970efde None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.199159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e508e-d024-4358-a42c-65e31970efde None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.199437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e508e-d024-4358-a42c-65e31970efde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.220804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-896e508e-d024-4358-a42c-65e31970efde None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:00.222020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-896e508e-d024-4358-a42c-65e31970efde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.286164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1219/2444] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:00.295166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70541298-06be-466b-b8a3-6af21e9ba9d9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.295448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70541298-06be-466b-b8a3-6af21e9ba9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.295752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70541298-06be-466b-b8a3-6af21e9ba9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.316968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-70541298-06be-466b-b8a3-6af21e9ba9d9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:00.318332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-70541298-06be-466b-b8a3-6af21e9ba9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.327832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1226/2445] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:00.332981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e508e-d024-4358-a42c-65e31970efde None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.347060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e508e-d024-4358-a42c-65e31970efde None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.353312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.353859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.354141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.354413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.355062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:37:00.355368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.357047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.369310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1220/2446] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:37:00.373771 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70541298-06be-466b-b8a3-6af21e9ba9d9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.383363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70541298-06be-466b-b8a3-6af21e9ba9d9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.388354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.388950 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.389227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.389496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.390128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.392067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.421531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1227/2447] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:37:00 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:37:00.426156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.436405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d57866-5681-40aa-b280-76a3dee3c2c1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.501314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.501925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.502201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.502574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.503219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.505177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.514805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:00.530024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1221/2448] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:37:00 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:37:00.534116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.545213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d96498-8dfa-4142-8734-6ebc9f4af25e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.550878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.551481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.551788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.552056 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.552792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.554396 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.565072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1228/2449] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:00.569379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.580058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f40d49-0096-4ccf-880e-2f16402e016f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.585520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ad73c-92d3-4542-b1e5-9b6f6f4d46bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.586118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad73c-92d3-4542-b1e5-9b6f6f4d46bb admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.586395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad73c-92d3-4542-b1e5-9b6f6f4d46bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.586661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad73c-92d3-4542-b1e5-9b6f6f4d46bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.587295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ad73c-92d3-4542-b1e5-9b6f6f4d46bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.588930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ad73c-92d3-4542-b1e5-9b6f6f4d46bb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.599766 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1222/2450] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:00.604260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.614686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb73fc1-f784-4709-87fa-90373af3f418 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.621528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.622167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.622473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.622740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] PATH_INFO: `/v3/projects/7c436b8727f949ac9b9459b1528c9cc0/users/402844b4e185430abcd62eb9f80c2e60/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.631189 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:00.637916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c436b8727f949ac9b9459b1528c9cc0, user_id=402844b4e185430abcd62eb9f80c2e60, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.640752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.657700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1229/2451] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:37:00 2022] PUT /identity/v3/projects/7c436b8727f949ac9b9459b1528c9cc0/users/402844b4e185430abcd62eb9f80c2e60/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:00.670450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb19684-d906-4446-b353-51a1ec7a247d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.670735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb19684-d906-4446-b353-51a1ec7a247d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.671006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb19684-d906-4446-b353-51a1ec7a247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.708373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0cb19684-d906-4446-b353-51a1ec7a247d None None] MFA Rules not processed for user `402844b4e185430abcd62eb9f80c2e60`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:00.709850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0cb19684-d906-4446-b353-51a1ec7a247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.782383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1223/2452] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:00.794156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.796080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.857659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c09e72-cbdc-4399-ac7f-2433c7d87f34 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.864584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09cd5c-0ab4-4d47-a460-096e729c0515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.866291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09cd5c-0ab4-4d47-a460-096e729c0515 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.866680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09cd5c-0ab4-4d47-a460-096e729c0515 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.867047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09cd5c-0ab4-4d47-a460-096e729c0515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.876600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09cd5c-0ab4-4d47-a460-096e729c0515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.878028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09cd5c-0ab4-4d47-a460-096e729c0515 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.887186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1230/2453] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:06.391257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb19684-d906-4446-b353-51a1ec7a247d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:06.459979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb19684-d906-4446-b353-51a1ec7a247d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:06.466115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:06.466749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:06.467022 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:06.467294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] PATH_INFO: `/v3/users/402844b4e185430abcd62eb9f80c2e60` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:06.468614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=402844b4e185430abcd62eb9f80c2e60)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:06.470577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:06.524184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402844b4e185430abcd62eb9f80c2e60'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:06.533698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402844b4e185430abcd62eb9f80c2e60'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:06.546679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402844b4e185430abcd62eb9f80c2e60'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:06.547612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402844b4e185430abcd62eb9f80c2e60'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:06.548784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:06.556206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402844b4e185430abcd62eb9f80c2e60'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:06.563436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1224/2454] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:37:06 2022] DELETE /identity/v3/users/402844b4e185430abcd62eb9f80c2e60 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:06.568055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:06.568521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:06.568633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:06.590035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:06.591259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:06.652612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1231/2455] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:06.663881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:06.665406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:06.723381 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e058e-3b3e-4608-aabf-576199ef5891 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:06.727903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96af0f7-11f2-4b49-aef4-15b048541974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:06.728515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af0f7-11f2-4b49-aef4-15b048541974 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:06.728799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af0f7-11f2-4b49-aef4-15b048541974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:06.729075 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96af0f7-11f2-4b49-aef4-15b048541974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:06.739078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af0f7-11f2-4b49-aef4-15b048541974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:06.740587 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96af0f7-11f2-4b49-aef4-15b048541974 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:06.750431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1225/2456] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:07.032646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.034301 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:07.047485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db5dd2-d166-423c-a85a-0c411f0db16e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.052992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.053715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.054498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.054498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] PATH_INFO: `/v3/projects/7c436b8727f949ac9b9459b1528c9cc0` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.055445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c436b8727f949ac9b9459b1528c9cc0)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.057566 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.109398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c436b8727f949ac9b9459b1528c9cc0', 'request_id': 'req-d5430b69-ac49-4958-a1ef-1fe079afc891'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:07.118785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c436b8727f949ac9b9459b1528c9cc0', 'request_id': 'req-d5430b69-ac49-4958-a1ef-1fe079afc891'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:07.126655 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c436b8727f949ac9b9459b1528c9cc0', 'request_id': 'req-d5430b69-ac49-4958-a1ef-1fe079afc891'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:07.138146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] The token cache is being invalidate because project 7c436b8727f949ac9b9459b1528c9cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:07.138543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:07.139278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d5430b69-ac49-4958-a1ef-1fe079afc891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:07.141418 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1232/2457] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:07 2022] DELETE /identity/v3/projects/7c436b8727f949ac9b9459b1528c9cc0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:07.146272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a540817-7a52-4108-a407-1ad4674c6fb4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.147017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a540817-7a52-4108-a407-1ad4674c6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.147017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a540817-7a52-4108-a407-1ad4674c6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.174144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5a540817-7a52-4108-a407-1ad4674c6fb4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:07.175425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5a540817-7a52-4108-a407-1ad4674c6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:07.235599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1226/2458] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:07.243829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478733d-4ef8-449f-8026-5d06f77c828e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.244118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478733d-4ef8-449f-8026-5d06f77c828e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.244388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478733d-4ef8-449f-8026-5d06f77c828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.264516 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e478733d-4ef8-449f-8026-5d06f77c828e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:07.265721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e478733d-4ef8-449f-8026-5d06f77c828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:07.273479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1233/2459] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:07.277870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a540817-7a52-4108-a407-1ad4674c6fb4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.288819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a540817-7a52-4108-a407-1ad4674c6fb4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.294588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.295300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.295671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.295946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.296599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:37:07.296906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.299134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.313633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1227/2460] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:37:07.318338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478733d-4ef8-449f-8026-5d06f77c828e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.328429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478733d-4ef8-449f-8026-5d06f77c828e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.333294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.333901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.334208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.334480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.335126 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.337070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.341719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:07.367871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1234/2461] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:37:07 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:37:07.377257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.388275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0792f63-65ce-48d9-bfc6-f8437ba50af4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.455306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.456032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.456234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.456505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.457156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.459134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.481649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1228/2462] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:37:07 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:37:07.485915 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.497186 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fd504-6fe2-4cde-8a3b-04a43aae32de admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.502539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.503150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.503430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.503736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.504387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.505995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.517061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1235/2463] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:07.521481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.532399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1996ff5-e6e5-4838-855e-2ed20a313a94 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.537516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f900ca3-f4a5-4c3e-93db-79781e7a2ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.538110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f900ca3-f4a5-4c3e-93db-79781e7a2ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.538386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f900ca3-f4a5-4c3e-93db-79781e7a2ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.538655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f900ca3-f4a5-4c3e-93db-79781e7a2ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.539315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f900ca3-f4a5-4c3e-93db-79781e7a2ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.540939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f900ca3-f4a5-4c3e-93db-79781e7a2ef6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.543132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:07.554881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1229/2464] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:07.558911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.569122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0737026-7e65-4e23-b610-95d55d6b9610 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.574141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.574796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.575069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.575340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] PATH_INFO: `/v3/projects/09b30cbb690a4fd79fa09ce67c740696/users/7308054fff834e7fadfd39a856a47530/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.590138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b30cbb690a4fd79fa09ce67c740696, user_id=7308054fff834e7fadfd39a856a47530, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.592785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.608320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1236/2465] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:37:07 2022] PUT /identity/v3/projects/09b30cbb690a4fd79fa09ce67c740696/users/7308054fff834e7fadfd39a856a47530/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:07.618831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737501-4954-47fc-b851-564dc57f99c0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.619119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737501-4954-47fc-b851-564dc57f99c0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.619394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737501-4954-47fc-b851-564dc57f99c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.647680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5c737501-4954-47fc-b851-564dc57f99c0 None None] MFA Rules not processed for user `7308054fff834e7fadfd39a856a47530`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:07.648899 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5c737501-4954-47fc-b851-564dc57f99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:07.732630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1230/2466] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:07.745511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:07.748986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:07.820446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d5cf9-c9a5-4e87-a9d5-069a565f53cc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:07.824672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:07.825276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:07.825653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:07.825980 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:07.836347 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:07.837770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:07.847576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1237/2467] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:17.729019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=33 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:17.842847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:20.464369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:20.464894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:20.465027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:20.496741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] MFA Rules not processed for user `bebd3b0bcdc04e77945fb9ddf8ca2d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:20.497990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:20.580094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1231/2468] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:24.076945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:24.078438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:24.168772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554380a-d34e-468e-8e10-66af83e58b4a service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:24.173854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:24.174596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:24.174884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:24.175160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:24.177188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:24.252747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:24.254202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:24.263815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1238/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:30.578597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=37 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:31.556511 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:31.558112 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:31.676970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896905e6-cc11-4e2c-b5df-167744f67170 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:31.684156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf67e31-6bc8-4d35-9cf8-76930d5674c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:31.684935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf67e31-6bc8-4d35-9cf8-76930d5674c2 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:31.685217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf67e31-6bc8-4d35-9cf8-76930d5674c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:31.685532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf67e31-6bc8-4d35-9cf8-76930d5674c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:31.687477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1cf67e31-6bc8-4d35-9cf8-76930d5674c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:31.702498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf67e31-6bc8-4d35-9cf8-76930d5674c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:31.704312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf67e31-6bc8-4d35-9cf8-76930d5674c2 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:31.716296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1232/2470] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:32.678405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:32.680078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:32.692141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83229d1-c093-4238-b7f4-8141fa49481f service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:32.696434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae5b36-562f-4e27-b949-d8791ea56f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:32.697044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5b36-562f-4e27-b949-d8791ea56f01 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:32.697327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5b36-562f-4e27-b949-d8791ea56f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:32.697601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae5b36-562f-4e27-b949-d8791ea56f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:32.699691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-89ae5b36-562f-4e27-b949-d8791ea56f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:32.793927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5b36-562f-4e27-b949-d8791ea56f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:32.795373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae5b36-562f-4e27-b949-d8791ea56f01 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:32.811943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:32.815648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1239/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:36.322362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22925-b5e3-4b4a-acef-3521bb5aecb4 None None] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:36.322362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22925-b5e3-4b4a-acef-3521bb5aecb4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:36.322362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a22925-b5e3-4b4a-acef-3521bb5aecb4 None None] PATH_INFO: `/` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:36.323085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1233/2472] 10.222.0.18 () {54 vars in 921 bytes} [Mon Sep 26 05:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:36.334097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:36.334568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:36.334674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:36.397657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] MFA Rules not processed for user `236e8947ce084c019d269170624fa35b`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:36.398890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:36.408635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1240/2473] 10.222.0.18 () {58 vars in 1018 bytes} [Mon Sep 26 05:37:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:36.614121 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22925-b5e3-4b4a-acef-3521bb5aecb4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:36.616079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-43a22925-b5e3-4b4a-acef-3521bb5aecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:36.636250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a22925-b5e3-4b4a-acef-3521bb5aecb4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:36.641444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:36.641950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:36.642310 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:36.642588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:36.654835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:36.657282 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:36.668672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1234/2474] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:42.058825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:42.061008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:42.094545 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a136b-fadd-40a1-8446-80316622dd83 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:42.101472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:42.102594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:42.103062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:42.103512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] PATH_INFO: `/v3/users/c7608d3fd5764366ac94f1f21784b636` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:42.105002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7608d3fd5764366ac94f1f21784b636)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:42.107247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:42.280996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7608d3fd5764366ac94f1f21784b636'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.301513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7608d3fd5764366ac94f1f21784b636'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.302873 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7608d3fd5764366ac94f1f21784b636'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.318335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7608d3fd5764366ac94f1f21784b636'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.356480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7608d3fd5764366ac94f1f21784b636'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.369363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1241/2475] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:37:42 2022] DELETE /identity/v3/users/c7608d3fd5764366ac94f1f21784b636 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:42.577178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:42.589461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cba8f-74a4-4ed9-91a9-accfd363dd61 service placement] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:42.650364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:42.651006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:42.651297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:42.651590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] PATH_INFO: `/v3/projects/02223a98b9734710a768b9885ca3afed` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:42.652705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02223a98b9734710a768b9885ca3afed)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:42.654597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:42.704966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02223a98b9734710a768b9885ca3afed', 'request_id': 'req-26622faf-acba-4c1b-a170-49fbb9734956'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.706920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:42.711327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02223a98b9734710a768b9885ca3afed', 'request_id': 'req-26622faf-acba-4c1b-a170-49fbb9734956'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.717601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02223a98b9734710a768b9885ca3afed', 'request_id': 'req-26622faf-acba-4c1b-a170-49fbb9734956'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.731729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] The token cache is being invalidate because project 02223a98b9734710a768b9885ca3afed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:42.732261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.732881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.734504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1235/2476] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:42 2022] DELETE /identity/v3/projects/02223a98b9734710a768b9885ca3afed => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:42.739190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:42.740672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:42.754260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f54bd-114e-460c-aae6-66bf30f647f2 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:42.816451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:42.817461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:42.817900 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:42.818168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] PATH_INFO: `/v3/users/ed76a43111c94798960bac3c763572e0` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:42.819470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed76a43111c94798960bac3c763572e0)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:42.821748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:42.865726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:42.883642 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed76a43111c94798960bac3c763572e0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.896218 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed76a43111c94798960bac3c763572e0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.896990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed76a43111c94798960bac3c763572e0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.908095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed76a43111c94798960bac3c763572e0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.920391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed76a43111c94798960bac3c763572e0'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:42.927860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1242/2477] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:37:42 2022] DELETE /identity/v3/users/ed76a43111c94798960bac3c763572e0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:43.171136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:43.174312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:43.189853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26622faf-acba-4c1b-a170-49fbb9734956 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:43.294897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:43.295836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:43.296670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:43.297125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] PATH_INFO: `/v3/projects/a063c6a70fc94b01b97f1e0e10e13f75` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:43.298870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a063c6a70fc94b01b97f1e0e10e13f75)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:43.301367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:43.405678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a063c6a70fc94b01b97f1e0e10e13f75', 'request_id': 'req-477ca38f-25c6-4712-ad81-52313914c81e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:43.414849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a063c6a70fc94b01b97f1e0e10e13f75', 'request_id': 'req-477ca38f-25c6-4712-ad81-52313914c81e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:43.432451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a063c6a70fc94b01b97f1e0e10e13f75', 'request_id': 'req-477ca38f-25c6-4712-ad81-52313914c81e'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:43.476382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] The token cache is being invalidate because project a063c6a70fc94b01b97f1e0e10e13f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:43.476688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:43.477460 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-477ca38f-25c6-4712-ad81-52313914c81e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:43.479309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1236/2478] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:43 2022] DELETE /identity/v3/projects/a063c6a70fc94b01b97f1e0e10e13f75 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:45.922464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:45.924377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:45.938665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66ea19-a9ca-40b8-b913-017df45f672b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:46.010534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:46.011164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.011439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.011739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] PATH_INFO: `/v3/users/7308054fff834e7fadfd39a856a47530` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.012914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7308054fff834e7fadfd39a856a47530)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:46.014826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:46.073100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7308054fff834e7fadfd39a856a47530'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.083394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7308054fff834e7fadfd39a856a47530'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.084100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7308054fff834e7fadfd39a856a47530'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.091860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7308054fff834e7fadfd39a856a47530'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.104041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7308054fff834e7fadfd39a856a47530'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.110001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1243/2479] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:37:45 2022] DELETE /identity/v3/users/7308054fff834e7fadfd39a856a47530 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:46.114703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.115221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.115351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.146818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:46.147998 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.211859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1237/2480] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:46.221853 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:46.223580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.263348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:46.310746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db848cbd-03be-41eb-b8a0-ac9f6585bac4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:46.315444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cf2fa-6a5d-4756-9325-75fb16735084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:46.316091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cf2fa-6a5d-4756-9325-75fb16735084 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.316360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cf2fa-6a5d-4756-9325-75fb16735084 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.316629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cf2fa-6a5d-4756-9325-75fb16735084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.326138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cf2fa-6a5d-4756-9325-75fb16735084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:46.327567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cf2fa-6a5d-4756-9325-75fb16735084 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:46.337286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1244/2481] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:46.614332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:46.615798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.624267 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:46.628826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec791-a3d6-4e56-a419-707c83ba818c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:46.635010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:46.635849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.636319 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.637046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] PATH_INFO: `/v3/projects/09b30cbb690a4fd79fa09ce67c740696` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.638452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b30cbb690a4fd79fa09ce67c740696)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:46.640629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:46.694656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b30cbb690a4fd79fa09ce67c740696', 'request_id': 'req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.700874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b30cbb690a4fd79fa09ce67c740696', 'request_id': 'req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.707334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b30cbb690a4fd79fa09ce67c740696', 'request_id': 'req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.722040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] The token cache is being invalidate because project 09b30cbb690a4fd79fa09ce67c740696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:46.722441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.723092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3bfe026c-dafe-44b6-9cf7-9ae16b002a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:46.724678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1238/2482] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:46 2022] DELETE /identity/v3/projects/09b30cbb690a4fd79fa09ce67c740696 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:46.729755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed409-d182-4b38-b24a-a10383448410 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.730040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed409-d182-4b38-b24a-a10383448410 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.730341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed409-d182-4b38-b24a-a10383448410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.769745 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-db2ed409-d182-4b38-b24a-a10383448410 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:46.771054 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-db2ed409-d182-4b38-b24a-a10383448410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.838026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1245/2483] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:46.846335 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ac81-3d93-49e7-b2ea-728ad3f26dac None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.846617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ac81-3d93-49e7-b2ea-728ad3f26dac None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.846893 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7ac81-3d93-49e7-b2ea-728ad3f26dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.868099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-75d7ac81-3d93-49e7-b2ea-728ad3f26dac None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:46.869391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-75d7ac81-3d93-49e7-b2ea-728ad3f26dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.878759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1239/2484] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:46.883522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed409-d182-4b38-b24a-a10383448410 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:46.893799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed409-d182-4b38-b24a-a10383448410 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:46.899727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:46.900330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.900605 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.900870 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.901514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:37:46.901814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:46.903408 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:46.915453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1246/2485] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:37:46.920080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7ac81-3d93-49e7-b2ea-728ad3f26dac None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:46.930019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7ac81-3d93-49e7-b2ea-728ad3f26dac None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:46.936767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:46.937374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.937653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.937925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.938761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:46.940755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:46.975986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1240/2486] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:37:46 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:37:46.980716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:46.992474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a697ef7-f5fe-4b3f-8e4e-b8909e541809 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:47.051798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:47.052455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.052701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.052983 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.053619 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:47.055581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:47.078052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1247/2487] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:37:46 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:37:47.083073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:47.093857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c47ec-715f-4002-8ad6-f4d1b6cfb0e2 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:47.099498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:47.100125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.100399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.100665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.101302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:47.102934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:47.113405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1241/2488] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:47.117525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:47.129037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68bd25-87ee-42ea-a797-6ba6249a6c63 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:47.134562 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57be71-0779-4518-bd21-ef1efb7442e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:47.135193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57be71-0779-4518-bd21-ef1efb7442e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.135473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57be71-0779-4518-bd21-ef1efb7442e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.135777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57be71-0779-4518-bd21-ef1efb7442e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.136388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57be71-0779-4518-bd21-ef1efb7442e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:47.138001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57be71-0779-4518-bd21-ef1efb7442e6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:47.149154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1248/2489] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:47.153470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:47.164260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79f1c4-6cb9-448f-ab47-7293d269e6c3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:47.169999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:47.170691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.170994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.171599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] PATH_INFO: `/v3/projects/d1f532ebce2142eab46c2e4f91c0e5ee/users/5be1947434c6468891287c5ad48c3843/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.186999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f532ebce2142eab46c2e4f91c0e5ee, user_id=5be1947434c6468891287c5ad48c3843, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:47.189754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:47.205919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1242/2490] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:37:47 2022] PUT /identity/v3/projects/d1f532ebce2142eab46c2e4f91c0e5ee/users/5be1947434c6468891287c5ad48c3843/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:47.216423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f8f2-1ec9-480a-9d99-59caf0f16bf7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.216804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f8f2-1ec9-480a-9d99-59caf0f16bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.217146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f8f2-1ec9-480a-9d99-59caf0f16bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.232235 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:47.248760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-89a5f8f2-1ec9-480a-9d99-59caf0f16bf7 None None] MFA Rules not processed for user `5be1947434c6468891287c5ad48c3843`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:47.250020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-89a5f8f2-1ec9-480a-9d99-59caf0f16bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:47.325404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1249/2491] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:47.336756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:47.338536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:47.425803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad462c60-2c0e-49b1-8d30-35efd8cec0e9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:47.430004 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9fc62-fa71-4846-a1a4-29e03b9208a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:47.430606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9fc62-fa71-4846-a1a4-29e03b9208a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.430882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9fc62-fa71-4846-a1a4-29e03b9208a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.431152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9fc62-fa71-4846-a1a4-29e03b9208a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.441102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9fc62-fa71-4846-a1a4-29e03b9208a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:47.442618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9fc62-fa71-4846-a1a4-29e03b9208a5 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:47.452081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1243/2492] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:47.478333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f8f2-1ec9-480a-9d99-59caf0f16bf7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:47.672903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f8f2-1ec9-480a-9d99-59caf0f16bf7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:47.678178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:47.678826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.679109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.679375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] PATH_INFO: `/v3/users/5be1947434c6468891287c5ad48c3843` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.680537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be1947434c6468891287c5ad48c3843)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:47.682459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:47.733050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be1947434c6468891287c5ad48c3843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:47.742606 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be1947434c6468891287c5ad48c3843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:47.743307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be1947434c6468891287c5ad48c3843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:47.750883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be1947434c6468891287c5ad48c3843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:47.765096 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be1947434c6468891287c5ad48c3843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:47.773451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1250/2493] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:37:47 2022] DELETE /identity/v3/users/5be1947434c6468891287c5ad48c3843 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:47.778384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.778613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.778949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.794467 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:47.802300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:47.804366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:47.869555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1244/2494] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:47.882091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:47.883509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:47.903053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:47.947758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557bcef-ce07-4e4e-b350-0f6bcf2d43eb admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:47.951858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed397e-41bc-4a21-93d8-6a5c87bb84fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:47.952585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed397e-41bc-4a21-93d8-6a5c87bb84fc service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.952954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed397e-41bc-4a21-93d8-6a5c87bb84fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.953316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed397e-41bc-4a21-93d8-6a5c87bb84fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.962687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed397e-41bc-4a21-93d8-6a5c87bb84fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:47.964150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed397e-41bc-4a21-93d8-6a5c87bb84fc service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:47.974187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1251/2495] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:48.367965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.369974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:48.402526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e043ba-f0b1-4cdf-99dd-f82a386ce221 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.419163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.421071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.421754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.422172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] PATH_INFO: `/v3/projects/d1f532ebce2142eab46c2e4f91c0e5ee` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.425247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f532ebce2142eab46c2e4f91c0e5ee)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.428553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.498437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f532ebce2142eab46c2e4f91c0e5ee', 'request_id': 'req-12724672-8f2c-4b18-bfb1-2ea071290f79'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:48.504937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f532ebce2142eab46c2e4f91c0e5ee', 'request_id': 'req-12724672-8f2c-4b18-bfb1-2ea071290f79'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:48.514032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f532ebce2142eab46c2e4f91c0e5ee', 'request_id': 'req-12724672-8f2c-4b18-bfb1-2ea071290f79'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:48.529875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] The token cache is being invalidate because project d1f532ebce2142eab46c2e4f91c0e5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:48.530320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:48.531077 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-12724672-8f2c-4b18-bfb1-2ea071290f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:48.533375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1245/2496] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:48 2022] DELETE /identity/v3/projects/d1f532ebce2142eab46c2e4f91c0e5ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:48.538250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab7fc7-f960-4f9e-9f85-f2581d25b15e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.538733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab7fc7-f960-4f9e-9f85-f2581d25b15e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.538830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab7fc7-f960-4f9e-9f85-f2581d25b15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.559618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-55ab7fc7-f960-4f9e-9f85-f2581d25b15e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:48.560788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-55ab7fc7-f960-4f9e-9f85-f2581d25b15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:48.621789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1252/2497] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:48.631034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98395-c23f-49f7-8b9e-cfa0e9e6412e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.631322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98395-c23f-49f7-8b9e-cfa0e9e6412e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.631627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98395-c23f-49f7-8b9e-cfa0e9e6412e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.651438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fac98395-c23f-49f7-8b9e-cfa0e9e6412e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:48.652906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fac98395-c23f-49f7-8b9e-cfa0e9e6412e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:48.663735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1246/2498] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:48.665597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab7fc7-f960-4f9e-9f85-f2581d25b15e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.675815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab7fc7-f960-4f9e-9f85-f2581d25b15e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.680629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.681232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.681505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.681773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.682442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:37:48.682737 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.684358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.696179 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1253/2499] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:37:48.700865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98395-c23f-49f7-8b9e-cfa0e9e6412e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.710517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98395-c23f-49f7-8b9e-cfa0e9e6412e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.715339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.716000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.716281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.716551 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.717215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.719145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.751673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1247/2500] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:37:48 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:37:48.752966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.763015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb10c6-ce0d-4fa1-8748-16e1fa6cd1af admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.819456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.820081 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.820395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.820666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.821296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.823205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.849377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1254/2501] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:37:48 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:37:48.853515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.864707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c663d11-3018-41a0-8625-b4fd73cda0ad admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.871516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.871846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.872160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.872586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.873265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.874877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.885503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1248/2502] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:48.889592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.900048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c845b-882b-4f62-abca-5ecdc08b59e1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.905973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e58692-080e-4789-982d-6f59331abf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.906587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e58692-080e-4789-982d-6f59331abf42 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.906840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e58692-080e-4789-982d-6f59331abf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.907106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e58692-080e-4789-982d-6f59331abf42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.907888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e58692-080e-4789-982d-6f59331abf42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.909482 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e58692-080e-4789-982d-6f59331abf42 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.921104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1255/2503] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:37:48.925820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.936798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320e00e-5c1e-4ec3-94ce-f5116bda9777 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.942958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.943666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.943949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.944225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] PATH_INFO: `/v3/projects/54b08d2a6e2a47eb9a2376a3647592df/users/8a208518f9604496a2473a5b48fab5d6/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.961805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b08d2a6e2a47eb9a2376a3647592df, user_id=8a208518f9604496a2473a5b48fab5d6, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.964604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.990801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1249/2504] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:37:48 2022] PUT /identity/v3/projects/54b08d2a6e2a47eb9a2376a3647592df/users/8a208518f9604496a2473a5b48fab5d6/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:48.993496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5944bc9-d3e5-4545-b7f7-37295b32e7fb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.993779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5944bc9-d3e5-4545-b7f7-37295b32e7fb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.994048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5944bc9-d3e5-4545-b7f7-37295b32e7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:49.027371 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d5944bc9-d3e5-4545-b7f7-37295b32e7fb None None] MFA Rules not processed for user `8a208518f9604496a2473a5b48fab5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:49.028640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d5944bc9-d3e5-4545-b7f7-37295b32e7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:49.042213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:49.109427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1256/2505] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:49.120614 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:49.122562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:49.156992 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:49.186474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95975001-81ef-4627-b520-2ad775bbf9ac admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:49.190207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:49.190821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:49.191103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:49.191375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:49.199720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:49.201174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:49.209854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1250/2506] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:49.616336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905c7c-3e68-4268-bcef-8f1a3525365a None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:49.616852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905c7c-3e68-4268-bcef-8f1a3525365a None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:49.617021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2905c7c-3e68-4268-bcef-8f1a3525365a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:49.637899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e2905c7c-3e68-4268-bcef-8f1a3525365a None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:49.639149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e2905c7c-3e68-4268-bcef-8f1a3525365a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:49.702626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1257/2507] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 05:37:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:49.757533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:49.759458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:49.837468 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13b7bf-71ce-4e60-bd02-16bf69ac4106 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:49.843399 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:49.844029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:49.844305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:49.844572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:49.853493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:49.855080 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:49.863351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1251/2508] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:37:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:37:50.582723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8342e4e-d233-44be-a5e1-f6116cd747db None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:50.582998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8342e4e-d233-44be-a5e1-f6116cd747db None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:50.583269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8342e4e-d233-44be-a5e1-f6116cd747db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:50.603439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c8342e4e-d233-44be-a5e1-f6116cd747db None None] MFA Rules not processed for user `8a208518f9604496a2473a5b48fab5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:50.604661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c8342e4e-d233-44be-a5e1-f6116cd747db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:50.611703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1258/2509] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:57.587110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:57.588682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:57.656797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5f28a-6539-4a67-ab63-99b5e06dcf32 service swift] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:57.661761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:57.662405 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:57.662682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:57.662957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] PATH_INFO: `/v3/users/39558065333c4a00888011aff539ee6c` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:57.664211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=39558065333c4a00888011aff539ee6c)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:57.666218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:57.720556 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39558065333c4a00888011aff539ee6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:57.729546 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39558065333c4a00888011aff539ee6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:57.735250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:57.743443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39558065333c4a00888011aff539ee6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:57.744348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39558065333c4a00888011aff539ee6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:57.771871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39558065333c4a00888011aff539ee6c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:57.778772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1252/2510] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:37:57 2022] DELETE /identity/v3/users/39558065333c4a00888011aff539ee6c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:58.056664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8342e4e-d233-44be-a5e1-f6116cd747db None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:58.071340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8342e4e-d233-44be-a5e1-f6116cd747db None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:58.132372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:58.133091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:58.133617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:58.133753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] PATH_INFO: `/v3/projects/d5ffb352f60c431db02da966fbb4d777` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:58.134997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ffb352f60c431db02da966fbb4d777)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:58.137092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:58.186885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:58.188568 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ffb352f60c431db02da966fbb4d777', 'request_id': 'req-56884841-165b-47fd-b2b7-7e81051f5dda'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.199048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ffb352f60c431db02da966fbb4d777', 'request_id': 'req-56884841-165b-47fd-b2b7-7e81051f5dda'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.206431 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ffb352f60c431db02da966fbb4d777', 'request_id': 'req-56884841-165b-47fd-b2b7-7e81051f5dda'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.219361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] The token cache is being invalidate because project d5ffb352f60c431db02da966fbb4d777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:58.219742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.220505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.225512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1259/2511] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:58 2022] DELETE /identity/v3/projects/d5ffb352f60c431db02da966fbb4d777 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:58.227341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:58.229092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:58.246884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3241-05a7-4c11-9e4e-9ba86c92b4cf admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:58.315646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:58.316297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:58.316575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:58.316840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] PATH_INFO: `/v3/users/e51cbe87166f414aa0742aabd736258f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:58.318027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51cbe87166f414aa0742aabd736258f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:58.319989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:58.373305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51cbe87166f414aa0742aabd736258f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.383101 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51cbe87166f414aa0742aabd736258f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.400539 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51cbe87166f414aa0742aabd736258f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.401208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51cbe87166f414aa0742aabd736258f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.409256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2a7ea444-3c56-4f9e-8ee3-30f3eb907b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51cbe87166f414aa0742aabd736258f'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.415359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1253/2512] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:37:58 2022] DELETE /identity/v3/users/e51cbe87166f414aa0742aabd736258f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:37:58.617522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:58.619228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:58.633266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56884841-165b-47fd-b2b7-7e81051f5dda admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:58.691307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:58.692053 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:58.692375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:58.692651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] PATH_INFO: `/v3/projects/e4a21b522d3f4eeda1cbcae125b39c02` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:58.693936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a21b522d3f4eeda1cbcae125b39c02)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:58.695896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:58.744555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a21b522d3f4eeda1cbcae125b39c02', 'request_id': 'req-dbf12a20-110c-444d-904b-5f95e19d8810'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.755283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a21b522d3f4eeda1cbcae125b39c02', 'request_id': 'req-dbf12a20-110c-444d-904b-5f95e19d8810'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.762648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a21b522d3f4eeda1cbcae125b39c02', 'request_id': 'req-dbf12a20-110c-444d-904b-5f95e19d8810'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.773439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] The token cache is being invalidate because project e4a21b522d3f4eeda1cbcae125b39c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:37:58.773796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.774602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-dbf12a20-110c-444d-904b-5f95e19d8810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:37:58.776156 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1260/2513] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:37:58 2022] DELETE /identity/v3/projects/e4a21b522d3f4eeda1cbcae125b39c02 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:38:07.003852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:07.004366 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:07.004884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.027020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:07.028338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.081844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:07.082372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:07.082702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.094233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1254/2514] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:38:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:07.102963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:07.104298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.107349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:07.108772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.111903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1261/2515] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:38:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:07.117542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:07.126327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:07.128094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.186948 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a912717-c2d3-4f9e-89d7-4c9fb47cf8aa None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:07.192001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2259d0-fc2c-4fba-8d29-a9db123dbd84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:07.192465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:07.192604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2259d0-fc2c-4fba-8d29-a9db123dbd84 service swift] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:07.193161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2259d0-fc2c-4fba-8d29-a9db123dbd84 service swift] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:07.193161 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2259d0-fc2c-4fba-8d29-a9db123dbd84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.199692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8b773-2385-4338-ac7d-0bd15dc5d341 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:07.202582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2259d0-fc2c-4fba-8d29-a9db123dbd84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:07.204429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2259d0-fc2c-4fba-8d29-a9db123dbd84 service swift] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:07.205958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:07.206571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:07.206851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:07.207120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.213496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1255/2516] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:38:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 05:38:07.215794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:07.218022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:07.228613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1262/2517] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:38:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 05:38:07.849866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d77f5c-7caa-4fa3-a57e-949611bf324a None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:07.850347 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d77f5c-7caa-4fa3-a57e-949611bf324a None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:07.850772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d77f5c-7caa-4fa3-a57e-949611bf324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.872800 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f5d77f5c-7caa-4fa3-a57e-949611bf324a None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:07.874361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f5d77f5c-7caa-4fa3-a57e-949611bf324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.882861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1256/2518] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 05:38:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:38:07.900180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:07.911467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab56c16-f7e1-4b50-9bbf-f5e45de00ec0 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:07.918049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:07.918660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:07.918938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:07.919211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.929007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:07.931289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:07.943133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1263/2519] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:38:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:08.243643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302d50-f4d8-4185-b9e9-a080b51856c2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:08.244736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302d50-f4d8-4185-b9e9-a080b51856c2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:08.245238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302d50-f4d8-4185-b9e9-a080b51856c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:08.266838 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5e302d50-f4d8-4185-b9e9-a080b51856c2 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:08.268406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5e302d50-f4d8-4185-b9e9-a080b51856c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:08.277351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1257/2520] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:38:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:38:08.301038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:08.312781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edf7a4-0a16-4d30-beed-d896c94e9483 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:08.318307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:08.318927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:08.319207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:08.319486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:08.329428 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:08.331098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:08.340657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1264/2521] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:08.738825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:08.739155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:08.739848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:08.786341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:08.788110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:08.797480 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1258/2522] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 05:38:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:08.820473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:08.834698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8754a-c14b-4665-9a62-70440fd9020a service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:08.840799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acac344-bf64-4d27-851f-498d6bd579e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:08.841742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acac344-bf64-4d27-851f-498d6bd579e7 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:08.842179 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acac344-bf64-4d27-851f-498d6bd579e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:08.842607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acac344-bf64-4d27-851f-498d6bd579e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:08.852285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acac344-bf64-4d27-851f-498d6bd579e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:08.855583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acac344-bf64-4d27-851f-498d6bd579e7 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:08.864627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1265/2523] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:38:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:11.150258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:11.152280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:11.235016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d906a8-8e43-439d-8e7b-474a95fdc9b5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:11.241889 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:11.243064 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:11.243356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:11.243665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] PATH_INFO: `/v3/users/8a208518f9604496a2473a5b48fab5d6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:11.244855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a208518f9604496a2473a5b48fab5d6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:11.246814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:11.323434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a208518f9604496a2473a5b48fab5d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.335577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a208518f9604496a2473a5b48fab5d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.350157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a208518f9604496a2473a5b48fab5d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.350906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a208518f9604496a2473a5b48fab5d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.353317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:11.360071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a208518f9604496a2473a5b48fab5d6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.369186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1259/2524] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:38:11 2022] DELETE /identity/v3/users/8a208518f9604496a2473a5b48fab5d6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:38:11.373780 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:11.374270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:11.374357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:11.395146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:11.396398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:11.463702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1266/2525] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:38:11.471651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:11.473076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:11.533379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff67b3a-73f2-44d1-96d0-0cc5c5d7be64 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:11.537125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff683f92-b255-4e16-a26e-8345405a1185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:11.537729 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683f92-b255-4e16-a26e-8345405a1185 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:11.538041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683f92-b255-4e16-a26e-8345405a1185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:11.538761 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff683f92-b255-4e16-a26e-8345405a1185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:11.549114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683f92-b255-4e16-a26e-8345405a1185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:11.550602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff683f92-b255-4e16-a26e-8345405a1185 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:11.561714 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1260/2526] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:11.762897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:11.764524 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:11.785366 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2a778-b2f9-4be8-a80d-0724591f3538 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:11.791531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:11.792962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:11.793674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:11.794095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] PATH_INFO: `/v3/projects/54b08d2a6e2a47eb9a2376a3647592df` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:11.795439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b08d2a6e2a47eb9a2376a3647592df)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:11.799612 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:11.859908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b08d2a6e2a47eb9a2376a3647592df', 'request_id': 'req-60c02a21-2103-49fe-ae92-060a8a029a15'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.869000 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b08d2a6e2a47eb9a2376a3647592df', 'request_id': 'req-60c02a21-2103-49fe-ae92-060a8a029a15'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.876747 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b08d2a6e2a47eb9a2376a3647592df', 'request_id': 'req-60c02a21-2103-49fe-ae92-060a8a029a15'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.889501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] The token cache is being invalidate because project 54b08d2a6e2a47eb9a2376a3647592df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:38:11.889796 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.890451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:11.891988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1267/2527] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:38:11 2022] DELETE /identity/v3/projects/54b08d2a6e2a47eb9a2376a3647592df => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:38:21.557724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=30 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:21.885836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:27.678906 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085516c6-06bb-4872-87c7-fbccc5a24144 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:27.679461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085516c6-06bb-4872-87c7-fbccc5a24144 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:27.679461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085516c6-06bb-4872-87c7-fbccc5a24144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:27.699725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-085516c6-06bb-4872-87c7-fbccc5a24144 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:27.701026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-085516c6-06bb-4872-87c7-fbccc5a24144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:27.759376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1261/2528] 10.222.0.18 () {58 vars in 1009 bytes} [Mon Sep 26 05:38:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:27.772108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:27.773695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:27.841968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02a21-2103-49fe-ae92-060a8a029a15 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:27.849008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:27.850065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:27.850423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:27.850790 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:27.860040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:27.861657 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:27.870171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1268/2529] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:37.752222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=25 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:37.866646 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=32 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:48.785050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:48.785526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:48.785639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:48.805246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] MFA Rules not processed for user `8bd38706158a47d8b0ff2b48b0fe082a`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:48.806461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:48.814033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1262/2530] 10.222.0.18 () {58 vars in 967 bytes} [Mon Sep 26 05:38:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:48.832035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:48.847614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d397-ec1e-413b-98cf-45e08dfea2ee service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:48.853966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f85a6800f914551b065fedc9bd4b558', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:48.854558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:48.854830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:48.855092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:48.864018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:48.865589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:48.873495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1269/2531] 10.222.0.18 () {60 vars in 1384 bytes} [Mon Sep 26 05:38:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:38:50.761581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:50.762975 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:50.819360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027954f-a5ca-4bbb-9d8e-7be4db3327b8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:50.823845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:50.824443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:50.824748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:50.825020 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:50.827050 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:50.890171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:50.891637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:50.901476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1263/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:54.086462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.088535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:54.103092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9315-e39d-458e-aa5a-d7db80969f62 service swift] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.107692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.108684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.108964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.109239 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] PATH_INFO: `/v3/users/dbd7677320d549a4bd492fa00a071f19` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.111443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd7677320d549a4bd492fa00a071f19)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.113535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:54.162152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd7677320d549a4bd492fa00a071f19'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.171941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd7677320d549a4bd492fa00a071f19'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.172593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd7677320d549a4bd492fa00a071f19'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.181789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd7677320d549a4bd492fa00a071f19'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.193458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd404490-0e14-44a5-ade8-868ee42e15a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd7677320d549a4bd492fa00a071f19'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.199421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1270/2533] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:38:54 2022] DELETE /identity/v3/users/dbd7677320d549a4bd492fa00a071f19 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:38:54.376524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.387108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a052b-65e9-4a87-b045-75300107c16c service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.444961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.445639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.445982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.446254 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] PATH_INFO: `/v3/projects/9992a793b16f4862834bc3daf0e44ed2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.447509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9992a793b16f4862834bc3daf0e44ed2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.449506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:54.505085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:54.508286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9992a793b16f4862834bc3daf0e44ed2', 'request_id': 'req-3e08f780-7262-402d-92f8-971bbeaf921b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.514950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9992a793b16f4862834bc3daf0e44ed2', 'request_id': 'req-3e08f780-7262-402d-92f8-971bbeaf921b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.521632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9992a793b16f4862834bc3daf0e44ed2', 'request_id': 'req-3e08f780-7262-402d-92f8-971bbeaf921b'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.536530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] The token cache is being invalidate because project 9992a793b16f4862834bc3daf0e44ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:38:54.536826 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.537471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-3e08f780-7262-402d-92f8-971bbeaf921b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:38:54.539013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1264/2534] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:38:54 2022] DELETE /identity/v3/projects/9992a793b16f4862834bc3daf0e44ed2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:38:54.544687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a094ea-28ac-4534-b75c-170490dece80 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.545454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a094ea-28ac-4534-b75c-170490dece80 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.545801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a094ea-28ac-4534-b75c-170490dece80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.571198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-70a094ea-28ac-4534-b75c-170490dece80 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:54.572432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-70a094ea-28ac-4534-b75c-170490dece80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:54.635086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1271/2535] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:54.643059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133cfe7-3ff6-4197-9317-9f1ae549b939 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.643396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133cfe7-3ff6-4197-9317-9f1ae549b939 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.644030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133cfe7-3ff6-4197-9317-9f1ae549b939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.671212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8133cfe7-3ff6-4197-9317-9f1ae549b939 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:54.672456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8133cfe7-3ff6-4197-9317-9f1ae549b939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:54.681483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1265/2536] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:54.686365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a094ea-28ac-4534-b75c-170490dece80 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.698058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a094ea-28ac-4534-b75c-170490dece80 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.702992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.703581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.703889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.704153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.704798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:38:54.705095 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.706693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:54.718043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1272/2537] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:38:54.722359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133cfe7-3ff6-4197-9317-9f1ae549b939 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.731461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133cfe7-3ff6-4197-9317-9f1ae549b939 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.736549 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.737245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.738135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.738135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.738451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.740227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:54.775025 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1266/2538] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:38:54 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:38:54.776161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.786374 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0004a-a10d-4c80-983e-6f0ba715de94 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.830435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:54.844762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.845383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.845703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.846174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.846981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.848774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:54.874402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1273/2539] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:38:54 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:38:54.879026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.894442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826fab3-c0a7-49cc-b0aa-c9bc47a9fcfb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.899293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.899932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.900213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.900483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.901123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.902728 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:54.912955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1267/2540] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:38:54.916968 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.927653 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0777115-0e1f-4916-a3bc-ca66d96ef7ac admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.932756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ee64d-b180-42d8-afa6-400c4dd82cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.933353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee64d-b180-42d8-afa6-400c4dd82cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.933628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee64d-b180-42d8-afa6-400c4dd82cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.933891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ee64d-b180-42d8-afa6-400c4dd82cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.934528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ee64d-b180-42d8-afa6-400c4dd82cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.936155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ee64d-b180-42d8-afa6-400c4dd82cf2 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:54.946837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1274/2541] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:38:54.950983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:54.961526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa91217-19fd-48ae-83dc-5a1d82124e49 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:54.966337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:54.966983 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:54.967260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:54.967531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] PATH_INFO: `/v3/projects/bcb05ba6e2274c7cb1065365b901c2a1/users/252a4407804743abae57541bd7645967/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:54.983818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb05ba6e2274c7cb1065365b901c2a1, user_id=252a4407804743abae57541bd7645967, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:54.986478 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:55.002326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1268/2542] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:38:54 2022] PUT /identity/v3/projects/bcb05ba6e2274c7cb1065365b901c2a1/users/252a4407804743abae57541bd7645967/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:38:55.013854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f4ba-7aea-4caf-be99-cbdbe40e75e0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:55.014364 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f4ba-7aea-4caf-be99-cbdbe40e75e0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:55.014750 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f4ba-7aea-4caf-be99-cbdbe40e75e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:55.044420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-e658f4ba-7aea-4caf-be99-cbdbe40e75e0 None None] MFA Rules not processed for user `252a4407804743abae57541bd7645967`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:55.045908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-e658f4ba-7aea-4caf-be99-cbdbe40e75e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:55.113192 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1275/2543] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:38:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:38:55.124773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:55.131996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:55.234869 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f30d28-2365-4afa-a086-ec01100ece7a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:55.240610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b62c8-36d5-4dfe-a80d-aa69d5ea5aac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:55.241222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b62c8-36d5-4dfe-a80d-aa69d5ea5aac service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:55.241501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b62c8-36d5-4dfe-a80d-aa69d5ea5aac service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:55.241768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b62c8-36d5-4dfe-a80d-aa69d5ea5aac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:55.249896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b62c8-36d5-4dfe-a80d-aa69d5ea5aac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:55.252375 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b62c8-36d5-4dfe-a80d-aa69d5ea5aac service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:55.262696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1269/2544] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:00.592521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658f4ba-7aea-4caf-be99-cbdbe40e75e0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:00.653283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658f4ba-7aea-4caf-be99-cbdbe40e75e0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:00.658547 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:00.659173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:00.659476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:00.659754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] PATH_INFO: `/v3/users/252a4407804743abae57541bd7645967` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:00.660991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252a4407804743abae57541bd7645967)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:00.663168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:00.716688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252a4407804743abae57541bd7645967'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:00.725752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252a4407804743abae57541bd7645967'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:00.726372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252a4407804743abae57541bd7645967'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:00.728694 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:00.734759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252a4407804743abae57541bd7645967'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:00.748433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252a4407804743abae57541bd7645967'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:00.754410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1276/2545] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:00 2022] DELETE /identity/v3/users/252a4407804743abae57541bd7645967 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:00.759902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:00.760430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:00.760430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:00.780153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:00.781360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:00.813755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:00.844754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1270/2546] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:00.854973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:00.856658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:00.933841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42c31b-f8db-4427-a785-ffb48f91b892 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:00.938550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534208e-e8b0-4f3b-bda2-f03c58e5ab40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:00.939161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534208e-e8b0-4f3b-bda2-f03c58e5ab40 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:00.939439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534208e-e8b0-4f3b-bda2-f03c58e5ab40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:00.939739 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534208e-e8b0-4f3b-bda2-f03c58e5ab40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:00.950084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534208e-e8b0-4f3b-bda2-f03c58e5ab40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:00.951522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534208e-e8b0-4f3b-bda2-f03c58e5ab40 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:00.961262 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1277/2547] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:01.244499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.245993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:01.258235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d57660-cffb-4589-a097-5ef62575ccf1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.263713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.264364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.264638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.264901 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] PATH_INFO: `/v3/projects/bcb05ba6e2274c7cb1065365b901c2a1` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.266114 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb05ba6e2274c7cb1065365b901c2a1)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.268115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:01.320509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb05ba6e2274c7cb1065365b901c2a1', 'request_id': 'req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:01.326086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb05ba6e2274c7cb1065365b901c2a1', 'request_id': 'req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:01.332293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb05ba6e2274c7cb1065365b901c2a1', 'request_id': 'req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:01.346398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] The token cache is being invalidate because project bcb05ba6e2274c7cb1065365b901c2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:01.346687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:01.347327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a74ac7c9-7b34-40d3-bd3e-909fbe6116a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:01.348822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1271/2548] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:01 2022] DELETE /identity/v3/projects/bcb05ba6e2274c7cb1065365b901c2a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:01.354862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9101-9361-4b93-aca3-5838ebccb25f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.355202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9101-9361-4b93-aca3-5838ebccb25f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.355667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9101-9361-4b93-aca3-5838ebccb25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.378015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-872a9101-9361-4b93-aca3-5838ebccb25f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:01.379249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-872a9101-9361-4b93-aca3-5838ebccb25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:01.442070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1278/2549] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:01.450216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b643de-13ae-4d90-800b-67332e1109d1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.450496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b643de-13ae-4d90-800b-67332e1109d1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.450765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b643de-13ae-4d90-800b-67332e1109d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.471229 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-19b643de-13ae-4d90-800b-67332e1109d1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:01.472586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-19b643de-13ae-4d90-800b-67332e1109d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:01.481582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1272/2550] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:01.486302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9101-9361-4b93-aca3-5838ebccb25f None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.498765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9101-9361-4b93-aca3-5838ebccb25f None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.504092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.504700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.504981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.505287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.505973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:01.506391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.508037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:01.520675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1279/2551] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:01.525363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b643de-13ae-4d90-800b-67332e1109d1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.534961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b643de-13ae-4d90-800b-67332e1109d1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.540145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.540748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.541028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.541302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.541936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.543890 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:01.575273 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1273/2552] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:01 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:01.579512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.590191 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1461b-2ec1-437a-8380-a3f670d3ad72 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.650990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.651703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.651880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.652150 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.652782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.654674 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:01.664985 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:01.683214 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1280/2553] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:01 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:01.687459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.697910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d925302-3fb2-4b87-b2ee-7f76e2489e86 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.702501 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.703096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.703373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.703682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.704316 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.705913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:01.715776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1274/2554] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:01.719673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.729554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2ec2c-789e-498f-a28a-7e9565874acc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.735572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5879f5-2a22-430d-b96f-d66ff09d56dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.736200 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5879f5-2a22-430d-b96f-d66ff09d56dd admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.736479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5879f5-2a22-430d-b96f-d66ff09d56dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.736748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5879f5-2a22-430d-b96f-d66ff09d56dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.737397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5879f5-2a22-430d-b96f-d66ff09d56dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.739037 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5879f5-2a22-430d-b96f-d66ff09d56dd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:01.751344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1281/2555] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:39:01.755490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.765825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5906974-bda8-49e8-ab97-0fbfebb9f661 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.771325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.772210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.772486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.772741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] PATH_INFO: `/v3/projects/076354ddcbac4224844aeab81be43833/users/c8f308bcbec8464fb34254599dd64bad/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.788426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076354ddcbac4224844aeab81be43833, user_id=c8f308bcbec8464fb34254599dd64bad, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.791132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:01.809246 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1275/2556] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:01 2022] PUT /identity/v3/projects/076354ddcbac4224844aeab81be43833/users/c8f308bcbec8464fb34254599dd64bad/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:01.815142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc831-49bb-483a-8355-be98d7339eae None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.815513 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc831-49bb-483a-8355-be98d7339eae None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.815902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edc831-49bb-483a-8355-be98d7339eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.841395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-08edc831-49bb-483a-8355-be98d7339eae None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:01.842537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-08edc831-49bb-483a-8355-be98d7339eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:01.909828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1282/2557] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:01.920810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:01.922696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:01.980784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54caf-afae-4970-8676-0c1c80c5d1a8 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:01.985260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:01.985896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:01.986307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:01.986580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:01.996380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:01.997828 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:02.001724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:02.008259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1276/2558] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:02.650420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad6fa-e12d-4fd8-9053-9e61c25a8439 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.650660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad6fa-e12d-4fd8-9053-9e61c25a8439 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.650962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ad6fa-e12d-4fd8-9053-9e61c25a8439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.689028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ed2ad6fa-e12d-4fd8-9053-9e61c25a8439 None None] MFA Rules not processed for user `c8f308bcbec8464fb34254599dd64bad`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:02.690509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ed2ad6fa-e12d-4fd8-9053-9e61c25a8439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:02.760100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1283/2559] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:02.764633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:02.774681 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cba3e-7d81-4852-a28f-f62f987ded85 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:02.779900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:02.780594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.780896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.781164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.781800 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:02.783753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:02.813329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1277/2560] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:02 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:02.817602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad6fa-e12d-4fd8-9053-9e61c25a8439 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:02.828494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ad6fa-e12d-4fd8-9053-9e61c25a8439 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:02.885230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:02.885841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.886120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.886394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.887028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:02.889060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:02.913139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1284/2561] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:02 2022] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:02.917422 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:02.928067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c5757-86a1-47fe-a549-07a834e1bdd4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:02.932974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:02.933573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.933881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.934152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.934794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:02.936430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:02.947320 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1278/2562] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:02.959844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:02.959844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:02.963229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e98ee1-48a7-44e2-97b0-88d9843a2840 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:02.969578 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:02.970278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.970550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.970821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] PATH_INFO: `/v3/projects/f0f85245448a486dbbde5a2e497dd2ad/users/f3b5a7ac44df4f5896c69b8ba93a7514/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.987806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f85245448a486dbbde5a2e497dd2ad, user_id=f3b5a7ac44df4f5896c69b8ba93a7514, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:02.990509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:03.007775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1285/2563] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:02 2022] PUT /identity/v3/projects/f0f85245448a486dbbde5a2e497dd2ad/users/f3b5a7ac44df4f5896c69b8ba93a7514/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:03.012639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:03.027008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b43a8-f289-4c2c-bd83-98d9569c018f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:03.094408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95f8e7-86e2-496b-85fe-c45d1b9ce9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:03.095026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f8e7-86e2-496b-85fe-c45d1b9ce9df admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:03.095307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f8e7-86e2-496b-85fe-c45d1b9ce9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:03.095602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f8e7-86e2-496b-85fe-c45d1b9ce9df admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:03.096249 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95f8e7-86e2-496b-85fe-c45d1b9ce9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:03.097859 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95f8e7-86e2-496b-85fe-c45d1b9ce9df admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:03.108173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1279/2564] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:03.112462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:03.123311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e50a5-62d6-469c-a6c0-3f92bd7c63a3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:03.128138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:03.128789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:03.129064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:03.129333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] PATH_INFO: `/v3/projects/f0f85245448a486dbbde5a2e497dd2ad/users/f3b5a7ac44df4f5896c69b8ba93a7514/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:03.131259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f85245448a486dbbde5a2e497dd2ad, user_id=f3b5a7ac44df4f5896c69b8ba93a7514, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:03.134086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:03.144410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1286/2565] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:03 2022] PUT /identity/v3/projects/f0f85245448a486dbbde5a2e497dd2ad/users/f3b5a7ac44df4f5896c69b8ba93a7514/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:03.823743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bb2dd-b8e4-45cc-87f8-29ee3ad36cc8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:03.824225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bb2dd-b8e4-45cc-87f8-29ee3ad36cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:03.824325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bb2dd-b8e4-45cc-87f8-29ee3ad36cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:03.852630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f64bb2dd-b8e4-45cc-87f8-29ee3ad36cc8 None None] MFA Rules not processed for user `f3b5a7ac44df4f5896c69b8ba93a7514`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:03.853874 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f64bb2dd-b8e4-45cc-87f8-29ee3ad36cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:03.928367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1280/2566] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:05.002695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:05.070255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94952bb9-9801-4be5-bc3a-717116267f45 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:05.075162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:05.075814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:05.076091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:05.076354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] PATH_INFO: `/v3/users/c8f308bcbec8464fb34254599dd64bad` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:05.077472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f308bcbec8464fb34254599dd64bad)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:05.079376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:05.136315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f308bcbec8464fb34254599dd64bad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.147035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f308bcbec8464fb34254599dd64bad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.147981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f308bcbec8464fb34254599dd64bad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.156030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f308bcbec8464fb34254599dd64bad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.169227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f308bcbec8464fb34254599dd64bad'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.175899 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1287/2567] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:05 2022] DELETE /identity/v3/users/c8f308bcbec8464fb34254599dd64bad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:05.362971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bb2dd-b8e4-45cc-87f8-29ee3ad36cc8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:05.374147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bb2dd-b8e4-45cc-87f8-29ee3ad36cc8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:05.421275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:05.435765 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:05.436403 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:05.436683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:05.436957 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] PATH_INFO: `/v3/projects/076354ddcbac4224844aeab81be43833` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:05.438083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076354ddcbac4224844aeab81be43833)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:05.440067 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:05.501430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076354ddcbac4224844aeab81be43833', 'request_id': 'req-adcf00f8-2776-4538-adc0-f08651d5af16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.510118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076354ddcbac4224844aeab81be43833', 'request_id': 'req-adcf00f8-2776-4538-adc0-f08651d5af16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.519876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076354ddcbac4224844aeab81be43833', 'request_id': 'req-adcf00f8-2776-4538-adc0-f08651d5af16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.535296 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] The token cache is being invalidate because project 076354ddcbac4224844aeab81be43833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:05.535598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.536263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.537774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1281/2568] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:05 2022] DELETE /identity/v3/projects/076354ddcbac4224844aeab81be43833 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:05.541935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:05.543412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:05.557055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7d5d0-b812-489f-9806-c6ccf36bb95c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:05.597871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:05.616509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:05.617201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:05.617479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:05.617756 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] PATH_INFO: `/v3/users/f3b5a7ac44df4f5896c69b8ba93a7514` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:05.618905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b5a7ac44df4f5896c69b8ba93a7514)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:05.620866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:05.676451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b5a7ac44df4f5896c69b8ba93a7514'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.685821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b5a7ac44df4f5896c69b8ba93a7514'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.686451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b5a7ac44df4f5896c69b8ba93a7514'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.694152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b5a7ac44df4f5896c69b8ba93a7514'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.706539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-da121015-d95e-4257-b93d-2bc1b482d673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b5a7ac44df4f5896c69b8ba93a7514'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:05.712683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1288/2569] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:05 2022] DELETE /identity/v3/users/f3b5a7ac44df4f5896c69b8ba93a7514 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:05.894162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:05.895842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:05.910649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf00f8-2776-4538-adc0-f08651d5af16 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:05.968520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:05.969153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:05.969424 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:05.969686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] PATH_INFO: `/v3/projects/f0f85245448a486dbbde5a2e497dd2ad` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:05.970825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f85245448a486dbbde5a2e497dd2ad)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:05.972762 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.027825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f85245448a486dbbde5a2e497dd2ad', 'request_id': 'req-8609a500-8766-47e6-9c79-cacfb3576d72'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:06.033472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f85245448a486dbbde5a2e497dd2ad', 'request_id': 'req-8609a500-8766-47e6-9c79-cacfb3576d72'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:06.039848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f85245448a486dbbde5a2e497dd2ad', 'request_id': 'req-8609a500-8766-47e6-9c79-cacfb3576d72'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:06.054459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] The token cache is being invalidate because project f0f85245448a486dbbde5a2e497dd2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:06.054744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:06.055446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8609a500-8766-47e6-9c79-cacfb3576d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:06.057059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1282/2570] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:05 2022] DELETE /identity/v3/projects/f0f85245448a486dbbde5a2e497dd2ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:06.062345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17c3b8-613c-472e-b9bc-2784324bb39d None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.062832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17c3b8-613c-472e-b9bc-2784324bb39d None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.062931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17c3b8-613c-472e-b9bc-2784324bb39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.086413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6c17c3b8-613c-472e-b9bc-2784324bb39d None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:06.087682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6c17c3b8-613c-472e-b9bc-2784324bb39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:06.152055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1289/2571] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:06.163783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b2dc5-6dc2-413b-ac2c-6708992f5475 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.163965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b2dc5-6dc2-413b-ac2c-6708992f5475 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.164317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b2dc5-6dc2-413b-ac2c-6708992f5475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.183783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:06.189442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-154b2dc5-6dc2-413b-ac2c-6708992f5475 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:06.191534 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-154b2dc5-6dc2-413b-ac2c-6708992f5475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:06.200748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1283/2572] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:06.205317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17c3b8-613c-472e-b9bc-2784324bb39d None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.217010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17c3b8-613c-472e-b9bc-2784324bb39d None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.222468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.223085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.223350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.223670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.224312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:06.224607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.226375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.238399 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1290/2573] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:06.243308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b2dc5-6dc2-413b-ac2c-6708992f5475 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.253627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b2dc5-6dc2-413b-ac2c-6708992f5475 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.260398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.260988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.261266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.261544 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.262178 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.264129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.296749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1284/2574] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:06 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:06.301083 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.311266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed958c7c-c679-42bd-b4ae-69c1c994725c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.359436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:06.373045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.373675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.373958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.374227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.374854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.376857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.399699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1291/2575] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:06 2022] POST /identity/v3/users => generated 279 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:06.404097 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.414590 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d652701-0412-4532-85fe-17bba18c7d73 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.419473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.420440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.420715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.420981 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.421613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.423211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.433262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1285/2576] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:06.437293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.447789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dd72b-7c02-4fb9-86dd-5d1e89abf122 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.453350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd915b15-3e2b-4e9f-8b6c-24ca5f33245f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.453975 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915b15-3e2b-4e9f-8b6c-24ca5f33245f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.454244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915b15-3e2b-4e9f-8b6c-24ca5f33245f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.454504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915b15-3e2b-4e9f-8b6c-24ca5f33245f admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.455131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd915b15-3e2b-4e9f-8b6c-24ca5f33245f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.456748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd915b15-3e2b-4e9f-8b6c-24ca5f33245f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.468393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1292/2577] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:06.472653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.482984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c04b-ab82-433a-9994-00ea63deb33e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.487927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.488563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.488831 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.489096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] PATH_INFO: `/v3/projects/bed71f9faca544428da3f02f5fb5e731/users/a337a025cd804ad6b38266c41ef54e7a/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.503986 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed71f9faca544428da3f02f5fb5e731, user_id=a337a025cd804ad6b38266c41ef54e7a, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.506773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.523852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1286/2578] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:06 2022] PUT /identity/v3/projects/bed71f9faca544428da3f02f5fb5e731/users/a337a025cd804ad6b38266c41ef54e7a/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:06.535196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7917655-9ba3-490d-a716-a7c3149ee99c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.535660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7917655-9ba3-490d-a716-a7c3149ee99c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.535938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7917655-9ba3-490d-a716-a7c3149ee99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.564784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d7917655-9ba3-490d-a716-a7c3149ee99c None None] MFA Rules not processed for user `a337a025cd804ad6b38266c41ef54e7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:06.566009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d7917655-9ba3-490d-a716-a7c3149ee99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:06.630507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1293/2579] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:06.635270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.697401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab37782-a28c-444b-af39-0549a18cf674 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.703085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.703745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.704023 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.704295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.704919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.706861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.737553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1287/2580] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:06 2022] POST /identity/v3/projects => generated 355 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:06.742026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7917655-9ba3-490d-a716-a7c3149ee99c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.753158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7917655-9ba3-490d-a716-a7c3149ee99c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.811378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.812023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.812302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.812572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.813211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.815137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.840166 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1294/2581] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:06 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:06.844329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.856224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3142d4f-6d48-4010-a12f-d0a140cd8c01 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.862242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.862851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.863127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.863401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.864081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.865696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.877332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1288/2582] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:06.883761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.899039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23119-0d45-4881-996c-2620affea448 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:06.904789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:06.905444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:06.905728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:06.905999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] PATH_INFO: `/v3/projects/b6539f31a4b04f47aa259fa39786e3e8/users/bf520d9c8fc34da5b4c83f0acbfc59f5/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:06.922477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6539f31a4b04f47aa259fa39786e3e8, user_id=bf520d9c8fc34da5b4c83f0acbfc59f5, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.925187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.940429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1295/2583] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:06 2022] PUT /identity/v3/projects/b6539f31a4b04f47aa259fa39786e3e8/users/bf520d9c8fc34da5b4c83f0acbfc59f5/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:06.944646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:06.958469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96292560-bf81-42d2-9ea9-cc9008bb7732 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:07.020421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6962a-eb30-4864-b138-08c64bfb8896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:07.021031 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6962a-eb30-4864-b138-08c64bfb8896 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:07.021303 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6962a-eb30-4864-b138-08c64bfb8896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:07.021573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6962a-eb30-4864-b138-08c64bfb8896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:07.022206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6962a-eb30-4864-b138-08c64bfb8896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:07.024029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6962a-eb30-4864-b138-08c64bfb8896 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:07.033757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1289/2584] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:07.038329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:07.049447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41319dc2-7f43-4445-adb3-ba50c421e029 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:07.054726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:07.055567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:07.055937 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:07.056230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] PATH_INFO: `/v3/projects/b6539f31a4b04f47aa259fa39786e3e8/users/bf520d9c8fc34da5b4c83f0acbfc59f5/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:07.058221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6539f31a4b04f47aa259fa39786e3e8, user_id=bf520d9c8fc34da5b4c83f0acbfc59f5, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:07.060933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:07.072241 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1296/2585] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:07 2022] PUT /identity/v3/projects/b6539f31a4b04f47aa259fa39786e3e8/users/bf520d9c8fc34da5b4c83f0acbfc59f5/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:07.082655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75009ac-4790-4e66-8ebf-505bf4da1b88 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:07.082968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75009ac-4790-4e66-8ebf-505bf4da1b88 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:07.083243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75009ac-4790-4e66-8ebf-505bf4da1b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:07.110019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:07.113654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b75009ac-4790-4e66-8ebf-505bf4da1b88 None None] MFA Rules not processed for user `bf520d9c8fc34da5b4c83f0acbfc59f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:07.115574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b75009ac-4790-4e66-8ebf-505bf4da1b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:07.202880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1290/2586] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:07.215245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:07.217322 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:07.232661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:07.285841 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450678a-d99e-4fc0-a460-7ad46b9b5ea3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:07.289632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:07.290333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:07.290610 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:07.290875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:07.300851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:07.302343 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:07.312237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1297/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:07.395526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75009ac-4790-4e66-8ebf-505bf4da1b88 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:07.406057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75009ac-4790-4e66-8ebf-505bf4da1b88 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:07.410212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:07.410815 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:07.411095 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:07.411352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:07.469008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:07.470358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:07.479492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1291/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:17.308395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=21 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:17.475239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=56 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:21.491988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:21.493376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:21.551759 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934cd0-0fda-42ac-a006-788882f92c3a service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:21.556212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fab6f-faa3-4d33-8f6d-54ec78d0208d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:21.556821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fab6f-faa3-4d33-8f6d-54ec78d0208d service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:21.557094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fab6f-faa3-4d33-8f6d-54ec78d0208d service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:21.557357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fab6f-faa3-4d33-8f6d-54ec78d0208d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:21.559414 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-931fab6f-faa3-4d33-8f6d-54ec78d0208d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:21.631318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fab6f-faa3-4d33-8f6d-54ec78d0208d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:21.632832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fab6f-faa3-4d33-8f6d-54ec78d0208d service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:21.643872 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1298/2589] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:22.795322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:22.807110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06503a9f-b103-4bb0-b226-b40f3b9cc6ff service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:22.811945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:22.812598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:22.812875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:22.813302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] PATH_INFO: `/v3/users/a337a025cd804ad6b38266c41ef54e7a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:22.814496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a337a025cd804ad6b38266c41ef54e7a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:22.816513 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:22.870530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a337a025cd804ad6b38266c41ef54e7a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:22.881293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a337a025cd804ad6b38266c41ef54e7a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:22.895035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a337a025cd804ad6b38266c41ef54e7a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:22.895775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a337a025cd804ad6b38266c41ef54e7a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:22.902705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a337a025cd804ad6b38266c41ef54e7a'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:22.909301 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1292/2590] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:22 2022] DELETE /identity/v3/users/a337a025cd804ad6b38266c41ef54e7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:22.913845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:22.914383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:22.914485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:22.936672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:22.937914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:22.998254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1299/2591] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:23.008006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:23.009655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:23.068183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fe658-20cd-496e-b103-52c71bac43dd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:23.072964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:23.073670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:23.074002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:23.074276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:23.084774 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:23.086642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:23.101085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1293/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:23.392052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:23.393596 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:23.429328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b3e94-538f-4438-ab05-1df42bb98c7c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:23.434659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:23.435971 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:23.436312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:23.436641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] PATH_INFO: `/v3/projects/bed71f9faca544428da3f02f5fb5e731` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:23.437867 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed71f9faca544428da3f02f5fb5e731)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:23.439876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:23.494419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:23.498940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed71f9faca544428da3f02f5fb5e731', 'request_id': 'req-4c9a5435-e5ab-4b83-a09f-e958d6719193'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.510835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed71f9faca544428da3f02f5fb5e731', 'request_id': 'req-4c9a5435-e5ab-4b83-a09f-e958d6719193'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.518666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed71f9faca544428da3f02f5fb5e731', 'request_id': 'req-4c9a5435-e5ab-4b83-a09f-e958d6719193'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.530361 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] The token cache is being invalidate because project bed71f9faca544428da3f02f5fb5e731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:23.530690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.531572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.534124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1300/2593] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:23 2022] DELETE /identity/v3/projects/bed71f9faca544428da3f02f5fb5e731 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:23.538166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:23.551363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc49e3-4236-4a17-ac0a-c3264ea44c6b service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:23.619965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:23.621407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:23.621407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:23.621671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] PATH_INFO: `/v3/users/bf520d9c8fc34da5b4c83f0acbfc59f5` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:23.622954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf520d9c8fc34da5b4c83f0acbfc59f5)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:23.625332 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:23.643404 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:23.688187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf520d9c8fc34da5b4c83f0acbfc59f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.699018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf520d9c8fc34da5b4c83f0acbfc59f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.713034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf520d9c8fc34da5b4c83f0acbfc59f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.713797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf520d9c8fc34da5b4c83f0acbfc59f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.721286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c330935c-772f-4542-8cdb-01e80bc40612 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf520d9c8fc34da5b4c83f0acbfc59f5'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:23.728401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1294/2594] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:23 2022] DELETE /identity/v3/users/bf520d9c8fc34da5b4c83f0acbfc59f5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:24.236209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:24.237992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:24.251584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a5435-e5ab-4b83-a09f-e958d6719193 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:24.329111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:24.329982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.330123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.330398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] PATH_INFO: `/v3/projects/b6539f31a4b04f47aa259fa39786e3e8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.331865 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6539f31a4b04f47aa259fa39786e3e8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:24.333901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:24.408783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6539f31a4b04f47aa259fa39786e3e8', 'request_id': 'req-c6bfb50c-6941-4325-8757-1106c27114a9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:24.419317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6539f31a4b04f47aa259fa39786e3e8', 'request_id': 'req-c6bfb50c-6941-4325-8757-1106c27114a9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:24.426369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6539f31a4b04f47aa259fa39786e3e8', 'request_id': 'req-c6bfb50c-6941-4325-8757-1106c27114a9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:24.445917 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] The token cache is being invalidate because project b6539f31a4b04f47aa259fa39786e3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:24.446162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:24.449706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c6bfb50c-6941-4325-8757-1106c27114a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:24.451817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1301/2595] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:24 2022] DELETE /identity/v3/projects/b6539f31a4b04f47aa259fa39786e3e8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:24.457665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0827e-5b2f-4a6c-a987-550dd6e49ed9 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.458083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0827e-5b2f-4a6c-a987-550dd6e49ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.458294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0827e-5b2f-4a6c-a987-550dd6e49ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.485518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-89d0827e-5b2f-4a6c-a987-550dd6e49ed9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:24.486782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-89d0827e-5b2f-4a6c-a987-550dd6e49ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:24.583259 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1295/2596] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:24.593117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431599f-ed46-4402-94ed-49ff6242f8d8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.593721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431599f-ed46-4402-94ed-49ff6242f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.594098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431599f-ed46-4402-94ed-49ff6242f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.623299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a431599f-ed46-4402-94ed-49ff6242f8d8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:24.625561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a431599f-ed46-4402-94ed-49ff6242f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:24.635481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1302/2597] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:24.639805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0827e-5b2f-4a6c-a987-550dd6e49ed9 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:24.653612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0827e-5b2f-4a6c-a987-550dd6e49ed9 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:24.658289 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:24.658938 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.659212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.659483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.660205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:24.660506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:24.662109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:24.682544 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431599f-ed46-4402-94ed-49ff6242f8d8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:24.687168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1296/2598] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:24.692933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431599f-ed46-4402-94ed-49ff6242f8d8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:24.697930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:24.698564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.698840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.699105 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.699789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:24.702023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:24.748247 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1303/2599] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:24 2022] POST /identity/v3/projects => generated 409 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:24.752017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:24.767758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dfc48-139b-4644-a376-4499dcbeaa48 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:24.850221 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:24.850841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.851120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.851557 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.857961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:24.861528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:24.887654 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1297/2600] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:24 2022] POST /identity/v3/users => generated 305 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:24.891665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:24.902469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca529f0-9a34-4a88-9f7d-07d8af77fa4c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:24.908069 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:24.908808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.909084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.909351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.909999 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:24.911645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:24.924868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1304/2601] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:24.928704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:24.941331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55470e3a-7307-467f-ae34-d6daf5556517 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:24.947236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96674409-3358-4180-858f-0f0336c2465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:24.947900 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674409-3358-4180-858f-0f0336c2465e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.948174 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674409-3358-4180-858f-0f0336c2465e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.948440 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96674409-3358-4180-858f-0f0336c2465e admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:24.949086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96674409-3358-4180-858f-0f0336c2465e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:24.950741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96674409-3358-4180-858f-0f0336c2465e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:24.956817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:24.972168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1298/2602] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:24.973389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:24.988800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044d396-a573-414b-9ad7-7297579650c6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:24.993840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:24.994507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:24.994786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:24.995057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] PATH_INFO: `/v3/projects/709296286bd549a4a8529f00d4cfc051/users/f313706152a84c0bb6ad8270488b8dde/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.009342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:25.016573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=709296286bd549a4a8529f00d4cfc051, user_id=f313706152a84c0bb6ad8270488b8dde, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.020102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.035570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1305/2603] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:24 2022] PUT /identity/v3/projects/709296286bd549a4a8529f00d4cfc051/users/f313706152a84c0bb6ad8270488b8dde/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:25.046465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ead8-15a6-4229-bb17-a3ad27b258e7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.046743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ead8-15a6-4229-bb17-a3ad27b258e7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.047015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12ead8-15a6-4229-bb17-a3ad27b258e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.077271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5b12ead8-15a6-4229-bb17-a3ad27b258e7 None None] MFA Rules not processed for user `f313706152a84c0bb6ad8270488b8dde`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:25.078976 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5b12ead8-15a6-4229-bb17-a3ad27b258e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.125666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.127876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.172582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1299/2604] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:25.177378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12ead8-15a6-4229-bb17-a3ad27b258e7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.210229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea654c0-808a-42b8-b3e9-9b122cc8fae5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.215061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.215601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.216158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.216582 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] PATH_INFO: `/v3/users/bebd3b0bcdc04e77945fb9ddf8ca2d5c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.231825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bebd3b0bcdc04e77945fb9ddf8ca2d5c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.233789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.253548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12ead8-15a6-4229-bb17-a3ad27b258e7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.263331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.264201 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.264498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.264904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.265605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.267894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.287237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bebd3b0bcdc04e77945fb9ddf8ca2d5c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.296753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bebd3b0bcdc04e77945fb9ddf8ca2d5c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.297648 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bebd3b0bcdc04e77945fb9ddf8ca2d5c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.299164 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1300/2605] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/projects => generated 407 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:25.302997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.305041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.313038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bebd3b0bcdc04e77945fb9ddf8ca2d5c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.326514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bebd3b0bcdc04e77945fb9ddf8ca2d5c'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.332658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1306/2606] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:25 2022] DELETE /identity/v3/users/bebd3b0bcdc04e77945fb9ddf8ca2d5c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:25.374582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8258d8-885c-49f0-9f46-a08f3368c6c6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.392861 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:25.433920 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.434542 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.434866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.435126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.435810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.437738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.459830 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1301/2607] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/users => generated 310 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:25.463804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.474016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97c83a-56db-4e88-8d2c-41da324c23ea admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.478933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.479613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.479949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.480287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.480992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.483190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.500863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1307/2608] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:25.502459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.508673 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.510554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.514698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870061a-66c2-427c-936a-397aee453bc6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.524435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6674dec-f523-41b7-b3e1-75633d156aab admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.527365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.528686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.528962 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.529243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] PATH_INFO: `/v3/projects/dfa241a2ac664f3c8599bbe47195ef56/users/2f3798a74917423384008aaea60e5fb2/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.530117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.531213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.531213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.531455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] PATH_INFO: `/v3/projects/d7ffa8ba0d2d48419afeefd8d5cd4e23` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.546485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ffa8ba0d2d48419afeefd8d5cd4e23)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.548526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.554091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa241a2ac664f3c8599bbe47195ef56, user_id=2f3798a74917423384008aaea60e5fb2, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.556818 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.573946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1302/2609] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:25 2022] PUT /identity/v3/projects/dfa241a2ac664f3c8599bbe47195ef56/users/2f3798a74917423384008aaea60e5fb2/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:25.578832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.588943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:25.601474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ffa8ba0d2d48419afeefd8d5cd4e23', 'request_id': 'req-86010985-7926-4389-abb0-f9661c5f3266'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.609713 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ffa8ba0d2d48419afeefd8d5cd4e23', 'request_id': 'req-86010985-7926-4389-abb0-f9661c5f3266'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.617307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ffa8ba0d2d48419afeefd8d5cd4e23', 'request_id': 'req-86010985-7926-4389-abb0-f9661c5f3266'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.627620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] The token cache is being invalidate because project d7ffa8ba0d2d48419afeefd8d5cd4e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:25.628151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.628836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-86010985-7926-4389-abb0-f9661c5f3266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:25.630380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1308/2610] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:25 2022] DELETE /identity/v3/projects/d7ffa8ba0d2d48419afeefd8d5cd4e23 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:25.635177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeb934-07cd-4988-b79a-f8682270446b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.635510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeb934-07cd-4988-b79a-f8682270446b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.635940 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafeb934-07cd-4988-b79a-f8682270446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.643911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b37366-b4b9-408b-97e9-889b038e3a98 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.657034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bafeb934-07cd-4988-b79a-f8682270446b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:25.658346 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bafeb934-07cd-4988-b79a-f8682270446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.699825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.700788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.700788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.701051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.701640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.703237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.712813 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1303/2611] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:25.716984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1309/2612] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:25.720109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.721723 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.724555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138cc5-0944-4e41-9cc8-771e771c8053 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.724840 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138cc5-0944-4e41-9cc8-771e771c8053 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.725110 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138cc5-0944-4e41-9cc8-771e771c8053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.734688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd6c53-b148-4087-9c45-a5c5b5b808d5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.739528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15319bed-2c03-499f-bb95-bf95b01e0079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.740202 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319bed-2c03-499f-bb95-bf95b01e0079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.740476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319bed-2c03-499f-bb95-bf95b01e0079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.740746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15319bed-2c03-499f-bb95-bf95b01e0079 admin admin] PATH_INFO: `/v3/projects/dfa241a2ac664f3c8599bbe47195ef56/users/2f3798a74917423384008aaea60e5fb2/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.742660 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319bed-2c03-499f-bb95-bf95b01e0079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa241a2ac664f3c8599bbe47195ef56, user_id=2f3798a74917423384008aaea60e5fb2, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.744742 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-af138cc5-0944-4e41-9cc8-771e771c8053 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:25.745327 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15319bed-2c03-499f-bb95-bf95b01e0079 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.745934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-af138cc5-0944-4e41-9cc8-771e771c8053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.754036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1310/2613] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:25.756555 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1304/2614] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:25 2022] PUT /identity/v3/projects/dfa241a2ac664f3c8599bbe47195ef56/users/2f3798a74917423384008aaea60e5fb2/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:25.765375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138cc5-0944-4e41-9cc8-771e771c8053 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.767193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.767477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.767616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138cc5-0944-4e41-9cc8-771e771c8053 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.767798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.795801 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] MFA Rules not processed for user `2f3798a74917423384008aaea60e5fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:25.797008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.802195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:25.828258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.828876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.829144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.829417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.830059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:25.830359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.832107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.844072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1311/2615] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:39:25.848594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.858564 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d80d-a35b-44de-b303-fcad6d490683 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.863585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.864178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.864451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.864727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.865344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.867208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.869078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1305/2616] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:25.880074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.881433 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:25.895467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1312/2617] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:25.899525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:25.931391 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:25.939452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21fbea-5423-4f34-8896-210e90774ab4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.964026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97e234-bb71-4b1e-87de-0946106ea798 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:25.968810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.969496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.969776 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.970042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.970669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:25.972608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:25.990461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02338250-9032-4a34-9ba1-bfc470b6d224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:25.991115 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02338250-9032-4a34-9ba1-bfc470b6d224 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:25.991528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02338250-9032-4a34-9ba1-bfc470b6d224 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:25.991837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02338250-9032-4a34-9ba1-bfc470b6d224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:25.998984 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1313/2618] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:25 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:26.000147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:26.009804 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27ad6f-ac98-49b0-a47a-e9a1d0d352f6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:26.015152 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:26.015769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.016047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.016302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.016957 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.018541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.028457 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1314/2619] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:26.032451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:26.041967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e6973-9f67-4539-99e1-b64b7027f79a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:26.047681 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:26.048272 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.048549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.048820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.049454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.051040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.053325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02338250-9032-4a34-9ba1-bfc470b6d224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.054776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02338250-9032-4a34-9ba1-bfc470b6d224 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.062639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1315/2620] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:26.066693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:26.069904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1306/2621] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:25 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:39:26.076690 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f940-4e62-4474-95c6-084ce2a01041 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:26.081698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:26.082360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.082632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.083141 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] PATH_INFO: `/v3/projects/f3bc68255a824289b837543c536eeffb/users/f2fc817f7492483aadd38f04b6d4f860/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.098539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bc68255a824289b837543c536eeffb, user_id=f2fc817f7492483aadd38f04b6d4f860, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.101269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.115609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1316/2622] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:26 2022] PUT /identity/v3/projects/f3bc68255a824289b837543c536eeffb/users/f2fc817f7492483aadd38f04b6d4f860/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:26.126913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.127401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.127911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.148364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=100 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:26.157528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] MFA Rules not processed for user `f2fc817f7492483aadd38f04b6d4f860`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:26.158757 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:26.229583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1307/2623] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:26.230905 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:26.241675 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:26.243156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:26.291085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe30cb-b03d-4a6b-ac2c-b675aeca641b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:26.296502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:26.297119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.297395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.297667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.299445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:26.324041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84668b1-18cb-4ce7-a0f8-ed0571efc195 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:26.334356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:26.334980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.335402 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.335604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.344662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.346276 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.355391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1308/2624] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:39:26.362201 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.363697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.373449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1317/2625] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:26 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:26.377611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:26.379034 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:26.390847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096ec80-bedb-49e0-a6c4-60abbfacfe60 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:26.394479 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:26.395079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.395357 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.395657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.397582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:26.412287 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.413721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.425662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1309/2626] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:26.797276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:26.806758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3ea7f-5243-4646-b896-5f5d5c5ad4d2 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:26.810493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a435c-a5c4-4b7f-a64c-3be55ab629bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:26.811184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a435c-a5c4-4b7f-a64c-3be55ab629bb service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:26.811535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a435c-a5c4-4b7f-a64c-3be55ab629bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:26.811896 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a435c-a5c4-4b7f-a64c-3be55ab629bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:26.813820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3e4a435c-a5c4-4b7f-a64c-3be55ab629bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:26.828686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a435c-a5c4-4b7f-a64c-3be55ab629bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:26.830436 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a435c-a5c4-4b7f-a64c-3be55ab629bb service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:26.842276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1318/2627] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:29.409129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:29.474773 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defd1e2-aafb-4613-97c1-12b9223d4a74 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:29.479817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:29.480448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:29.480726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:29.480997 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] PATH_INFO: `/v3/users/f2fc817f7492483aadd38f04b6d4f860` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:29.482162 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2fc817f7492483aadd38f04b6d4f860)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:29.484124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:29.498147 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:29.538323 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2fc817f7492483aadd38f04b6d4f860'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:29.548970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2fc817f7492483aadd38f04b6d4f860'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:29.567336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2fc817f7492483aadd38f04b6d4f860'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:29.568505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2fc817f7492483aadd38f04b6d4f860'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:29.580177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2fc817f7492483aadd38f04b6d4f860'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:29.586886 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1310/2628] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:29 2022] DELETE /identity/v3/users/f2fc817f7492483aadd38f04b6d4f860 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:29.591575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:29.592094 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:29.592209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:29.612223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:29.613427 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:29.622080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:29.680271 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1319/2629] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:29.690730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:29.692373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:29.753379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27276db7-53e4-4b35-ac6a-5dab17d6eeb4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:29.757550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58826efd-48a8-4f29-b4f7-72da92009285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:29.758153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826efd-48a8-4f29-b4f7-72da92009285 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:29.758429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826efd-48a8-4f29-b4f7-72da92009285 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:29.758696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58826efd-48a8-4f29-b4f7-72da92009285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:29.768103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58826efd-48a8-4f29-b4f7-72da92009285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:29.769532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58826efd-48a8-4f29-b4f7-72da92009285 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:29.779419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1311/2630] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:30.059114 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.060662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:30.074146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff766c-7f20-4fd0-845d-7948beedab86 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.079801 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.080478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.080746 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.081018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] PATH_INFO: `/v3/projects/f3bc68255a824289b837543c536eeffb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.082261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bc68255a824289b837543c536eeffb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.084402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.138104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bc68255a824289b837543c536eeffb', 'request_id': 'req-9042873e-58cf-4149-a892-343bce9286eb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:30.146175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bc68255a824289b837543c536eeffb', 'request_id': 'req-9042873e-58cf-4149-a892-343bce9286eb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:30.152416 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bc68255a824289b837543c536eeffb', 'request_id': 'req-9042873e-58cf-4149-a892-343bce9286eb'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:30.162445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] The token cache is being invalidate because project f3bc68255a824289b837543c536eeffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:30.162734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:30.163354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9042873e-58cf-4149-a892-343bce9286eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:30.164854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1320/2631] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:30 2022] DELETE /identity/v3/projects/f3bc68255a824289b837543c536eeffb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:30.170205 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e2fe-386c-4502-b63d-ef1baacf60fc None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.170604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e2fe-386c-4502-b63d-ef1baacf60fc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.170915 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627e2fe-386c-4502-b63d-ef1baacf60fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.192265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-b627e2fe-386c-4502-b63d-ef1baacf60fc None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:30.193486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-b627e2fe-386c-4502-b63d-ef1baacf60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:30.254793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1312/2632] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:30.264052 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc549c-1a77-49cc-b2bd-7872fdf712a0 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.264333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc549c-1a77-49cc-b2bd-7872fdf712a0 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.264624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc549c-1a77-49cc-b2bd-7872fdf712a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.285308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-26fc549c-1a77-49cc-b2bd-7872fdf712a0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:30.286518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-26fc549c-1a77-49cc-b2bd-7872fdf712a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:30.295585 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1321/2633] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:30.300465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e2fe-386c-4502-b63d-ef1baacf60fc None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.310993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627e2fe-386c-4502-b63d-ef1baacf60fc None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.317007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.317616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.317891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.318170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.318814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:30.319099 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.320747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.333092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1313/2634] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:30.337444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc549c-1a77-49cc-b2bd-7872fdf712a0 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.347120 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc549c-1a77-49cc-b2bd-7872fdf712a0 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.352075 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.352677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.352953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.353198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.353842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.355774 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.385645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1322/2635] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:30 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:30.389932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.400241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba22c51-3e9d-4331-965b-814c5ddc170e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.420750 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:30.470744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.471358 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.471676 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.471949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.472589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.474525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.501736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1314/2636] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:30 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:30.505932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.517518 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb77db0-eac5-4172-93b3-25899ec3b816 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.528561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.529357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.530527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.530527 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.531254 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.533439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.544442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1323/2637] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:30.549240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.561024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4955388-ea44-4272-9f70-7ba13d740087 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.572290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3ea38-925a-4472-8258-2049027a0ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.573143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ea38-925a-4472-8258-2049027a0ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.573579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ea38-925a-4472-8258-2049027a0ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.574043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ea38-925a-4472-8258-2049027a0ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.574892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3ea38-925a-4472-8258-2049027a0ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.577187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3ea38-925a-4472-8258-2049027a0ddd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.590744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1315/2638] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:39:30.595133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.605250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7742ef-6a3f-4394-a6ab-15aafc69d6bc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.609773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.610471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.610753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.611031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] PATH_INFO: `/v3/projects/86ed77f26b5648ecb050e3887ba8971b/users/f910159e2cd0488f8cdcd13058175cc9/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.626714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ed77f26b5648ecb050e3887ba8971b, user_id=f910159e2cd0488f8cdcd13058175cc9, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.629611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.643522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1324/2639] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:30 2022] PUT /identity/v3/projects/86ed77f26b5648ecb050e3887ba8971b/users/f910159e2cd0488f8cdcd13058175cc9/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:30.654473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32933b7-7e41-44b6-8693-449ec86bc904 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.654763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32933b7-7e41-44b6-8693-449ec86bc904 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.655040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32933b7-7e41-44b6-8693-449ec86bc904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.685261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f32933b7-7e41-44b6-8693-449ec86bc904 None None] MFA Rules not processed for user `f910159e2cd0488f8cdcd13058175cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:30.686574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f32933b7-7e41-44b6-8693-449ec86bc904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:30.756518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1316/2640] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:30.761129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.796839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:30.825783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df6e8a-fce7-4e73-8741-922222b8eada admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.830888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.831525 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.831852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.832123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.832757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.834641 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.861973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1325/2641] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:30 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:30.866195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32933b7-7e41-44b6-8693-449ec86bc904 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.877770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32933b7-7e41-44b6-8693-449ec86bc904 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.940028 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.940848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.941216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.941568 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.942503 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.945560 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:30.972608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1317/2642] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:30 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:30.977147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:30.988728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd128266-ed70-4477-9afd-e87ec401aa90 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:30.994619 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:30.995228 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:30.995506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:30.995816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:30.996460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:30.998088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:31.009478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1326/2643] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:39:31.014010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:31.024782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac031117-7ad7-4320-afd9-e9085bd6666c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:31.030993 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:31.031746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.032204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.032473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] PATH_INFO: `/v3/projects/1bbe8fdc350a4e36ba5ff16843ccd5db/users/80ce67560a0f4d69a01137e9fff6c19d/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.051087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbe8fdc350a4e36ba5ff16843ccd5db, user_id=80ce67560a0f4d69a01137e9fff6c19d, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:31.053903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:31.056212 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:31.069135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1318/2644] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:31 2022] PUT /identity/v3/projects/1bbe8fdc350a4e36ba5ff16843ccd5db/users/80ce67560a0f4d69a01137e9fff6c19d/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:31.073758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:31.084784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8037b-2722-4ee6-a7be-190af23689dc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:31.143122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb69dd0-0f69-4c84-b44d-e022bdb24542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:31.143775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb69dd0-0f69-4c84-b44d-e022bdb24542 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.144049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb69dd0-0f69-4c84-b44d-e022bdb24542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.144453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb69dd0-0f69-4c84-b44d-e022bdb24542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.145102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb69dd0-0f69-4c84-b44d-e022bdb24542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:31.146715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb69dd0-0f69-4c84-b44d-e022bdb24542 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:31.156616 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1327/2645] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:31.161365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:31.172108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8669d4-7c0b-4471-ad8c-fadf6acdd054 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:31.176958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:31.177602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.177878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.178145 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] PATH_INFO: `/v3/projects/1bbe8fdc350a4e36ba5ff16843ccd5db/users/80ce67560a0f4d69a01137e9fff6c19d/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.180018 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bbe8fdc350a4e36ba5ff16843ccd5db, user_id=80ce67560a0f4d69a01137e9fff6c19d, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:31.182632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:31.193088 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1319/2646] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:31 2022] PUT /identity/v3/projects/1bbe8fdc350a4e36ba5ff16843ccd5db/users/80ce67560a0f4d69a01137e9fff6c19d/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:31.203376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdfd6-b924-4e00-92d6-6253230e5891 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.203696 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdfd6-b924-4e00-92d6-6253230e5891 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.204104 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbdfd6-b924-4e00-92d6-6253230e5891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.233965 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a3dbdfd6-b924-4e00-92d6-6253230e5891 None None] MFA Rules not processed for user `80ce67560a0f4d69a01137e9fff6c19d`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:31.235389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a3dbdfd6-b924-4e00-92d6-6253230e5891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:31.310222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1328/2647] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:31.325084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:31.327055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:31.390868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bbed-c54c-4c82-859b-d2f7b4476bba admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:31.394954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:31.395580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.396019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.396300 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.406053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:31.407611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:31.417151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1320/2648] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:31.503677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbdfd6-b924-4e00-92d6-6253230e5891 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:31.514792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbdfd6-b924-4e00-92d6-6253230e5891 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:31.519818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d78e6e-141c-4387-ba9f-4b04843df269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:31.520441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d78e6e-141c-4387-ba9f-4b04843df269 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.520721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d78e6e-141c-4387-ba9f-4b04843df269 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.521015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d78e6e-141c-4387-ba9f-4b04843df269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.549632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:31.585323 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d78e6e-141c-4387-ba9f-4b04843df269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:31.586565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d78e6e-141c-4387-ba9f-4b04843df269 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:31.596729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1329/2649] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:31.812364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:31.813880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:31.880724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366e8da-f5ec-4458-a53b-40f4a713eff5 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:31.885386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:31.886038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.886315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.886585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] PATH_INFO: `/v3/users/f313706152a84c0bb6ad8270488b8dde` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.887783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f313706152a84c0bb6ad8270488b8dde)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:31.889721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:31.938583 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f313706152a84c0bb6ad8270488b8dde'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:31.946754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f313706152a84c0bb6ad8270488b8dde'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:31.959234 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f313706152a84c0bb6ad8270488b8dde'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:31.959918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f313706152a84c0bb6ad8270488b8dde'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:31.968286 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f313706152a84c0bb6ad8270488b8dde'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:31.974641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1321/2650] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:31 2022] DELETE /identity/v3/users/f313706152a84c0bb6ad8270488b8dde => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:31.979238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:31.979658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:31.979827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:31.999936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:32.001224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:32.061462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1330/2651] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:32.072158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:32.074447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:32.080805 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:32.134881 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef622-869c-4201-aaff-a797cd373398 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:32.139849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:32.140526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:32.140811 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:32.141085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:32.152324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:32.153758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:32.163726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1322/2652] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:32.441022 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:32.442871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:32.457377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66546c97-3f43-4476-bc29-48383ae15cf5 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:32.463445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:32.464230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:32.464390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:32.464660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] PATH_INFO: `/v3/projects/709296286bd549a4a8529f00d4cfc051` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:32.465911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=709296286bd549a4a8529f00d4cfc051)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:32.468411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:32.517118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '709296286bd549a4a8529f00d4cfc051', 'request_id': 'req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.526691 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '709296286bd549a4a8529f00d4cfc051', 'request_id': 'req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.533699 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '709296286bd549a4a8529f00d4cfc051', 'request_id': 'req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.544986 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] The token cache is being invalidate because project 709296286bd549a4a8529f00d4cfc051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:32.545275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.545956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.547493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1331/2653] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:32 2022] DELETE /identity/v3/projects/709296286bd549a4a8529f00d4cfc051 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:32.551701 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:32.561505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea73f51f-7d98-495a-b423-4eab31690168 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:32.624709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:32.625340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:32.625620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:32.625878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] PATH_INFO: `/v3/users/2f3798a74917423384008aaea60e5fb2` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:32.627776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f3798a74917423384008aaea60e5fb2)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:32.629770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:32.679052 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f3798a74917423384008aaea60e5fb2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.688980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f3798a74917423384008aaea60e5fb2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.702743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f3798a74917423384008aaea60e5fb2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.703496 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f3798a74917423384008aaea60e5fb2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.711144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-116207d6-d71a-4802-a26b-ff7366a7d3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f3798a74917423384008aaea60e5fb2'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:32.717251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1323/2654] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:32 2022] DELETE /identity/v3/users/2f3798a74917423384008aaea60e5fb2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:33.001623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.003253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:33.017784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6b91-488b-49ca-bbcb-d4d73d9a7094 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.070490 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:33.083787 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.084290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.084827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.085481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] PATH_INFO: `/v3/projects/dfa241a2ac664f3c8599bbe47195ef56` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.087412 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa241a2ac664f3c8599bbe47195ef56)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.090188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.159943 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa241a2ac664f3c8599bbe47195ef56', 'request_id': 'req-725746a5-fe6d-48ed-b360-4fb1db9f2161'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:33.168962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa241a2ac664f3c8599bbe47195ef56', 'request_id': 'req-725746a5-fe6d-48ed-b360-4fb1db9f2161'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:33.176504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa241a2ac664f3c8599bbe47195ef56', 'request_id': 'req-725746a5-fe6d-48ed-b360-4fb1db9f2161'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:33.195465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] The token cache is being invalidate because project dfa241a2ac664f3c8599bbe47195ef56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:33.195878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:33.196620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-725746a5-fe6d-48ed-b360-4fb1db9f2161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:33.198385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1332/2655] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:33 2022] DELETE /identity/v3/projects/dfa241a2ac664f3c8599bbe47195ef56 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:33.205264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90dd81-c49d-41f2-9ca7-5c70173ddc98 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.205795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90dd81-c49d-41f2-9ca7-5c70173ddc98 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.205903 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90dd81-c49d-41f2-9ca7-5c70173ddc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.236756 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-4d90dd81-c49d-41f2-9ca7-5c70173ddc98 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:33.237971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-4d90dd81-c49d-41f2-9ca7-5c70173ddc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:33.256550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:33.305016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1324/2656] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:33.316894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf084-c554-4d28-81af-78139d0f0cce None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.317184 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf084-c554-4d28-81af-78139d0f0cce None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.317514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68edf084-c554-4d28-81af-78139d0f0cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.341020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-68edf084-c554-4d28-81af-78139d0f0cce None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:33.342210 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-68edf084-c554-4d28-81af-78139d0f0cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:33.350162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1333/2657] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:33.354463 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90dd81-c49d-41f2-9ca7-5c70173ddc98 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.365355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90dd81-c49d-41f2-9ca7-5c70173ddc98 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.371565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.372173 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.372447 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.372719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.373363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:33.373696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.375609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.388925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1325/2658] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:33.393777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edf084-c554-4d28-81af-78139d0f0cce None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.403043 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68edf084-c554-4d28-81af-78139d0f0cce None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.408101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.408688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.408961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.409232 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.409860 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.411763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.442579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1334/2659] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:33 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:33.446810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.457132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604562-aeac-4fe3-b1be-9d78d67c6182 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.520530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.521125 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.521398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.521665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.522288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.524250 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.549490 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1326/2660] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:33 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:33.555636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.568805 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92103402-4072-437e-81fd-5cce52f78c50 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.573824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.574434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.574714 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.574990 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.575707 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.577299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.587359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1335/2661] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:33.591264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.601518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15991e-6da4-4d38-ab97-3984f67c8cdc admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.606849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5325f2-2b30-4e12-9f2f-ab879dff3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.607438 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5325f2-2b30-4e12-9f2f-ab879dff3b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.607754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5325f2-2b30-4e12-9f2f-ab879dff3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.608024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5325f2-2b30-4e12-9f2f-ab879dff3b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.608631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5325f2-2b30-4e12-9f2f-ab879dff3b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.610288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5325f2-2b30-4e12-9f2f-ab879dff3b82 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.621171 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1327/2662] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:33.625264 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.635446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b8e8-37a2-4331-beb7-18bfe5750b6d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.640444 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.641090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.641383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.641789 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] PATH_INFO: `/v3/projects/c7dc3e4d8804438194932520221be410/users/cc6490250dbe4048aa8c9244f33bd7e6/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.656660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7dc3e4d8804438194932520221be410, user_id=cc6490250dbe4048aa8c9244f33bd7e6, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.659429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.675489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1336/2663] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:33 2022] PUT /identity/v3/projects/c7dc3e4d8804438194932520221be410/users/cc6490250dbe4048aa8c9244f33bd7e6/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:33.686806 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e600-2f2c-4ca5-95f7-7f8da6727add None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.687165 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e600-2f2c-4ca5-95f7-7f8da6727add None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.687488 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0e600-2f2c-4ca5-95f7-7f8da6727add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.718176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-5ca0e600-2f2c-4ca5-95f7-7f8da6727add None None] MFA Rules not processed for user `cc6490250dbe4048aa8c9244f33bd7e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:33.719410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5ca0e600-2f2c-4ca5-95f7-7f8da6727add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:33.790079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1328/2664] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:33.802569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.804250 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:33.867171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131cd93-d618-4af5-be2d-c8a8c89f5f61 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.871273 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1eb30-7a69-44df-8f6e-c6d997ef593a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.871907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1eb30-7a69-44df-8f6e-c6d997ef593a service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.872178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1eb30-7a69-44df-8f6e-c6d997ef593a service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.872443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1eb30-7a69-44df-8f6e-c6d997ef593a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.880974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1eb30-7a69-44df-8f6e-c6d997ef593a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.882386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1eb30-7a69-44df-8f6e-c6d997ef593a service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:33.890909 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1337/2665] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:33.911443 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e600-2f2c-4ca5-95f7-7f8da6727add None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:33.934698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:33.981481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0e600-2f2c-4ca5-95f7-7f8da6727add None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:33.987477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:33.988154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:33.988442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:33.988711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] PATH_INFO: `/v3/users/cc6490250dbe4048aa8c9244f33bd7e6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:33.989991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6490250dbe4048aa8c9244f33bd7e6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:33.991978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:34.044470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6490250dbe4048aa8c9244f33bd7e6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.053636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6490250dbe4048aa8c9244f33bd7e6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.065626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6490250dbe4048aa8c9244f33bd7e6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.066294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6490250dbe4048aa8c9244f33bd7e6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.073369 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6490250dbe4048aa8c9244f33bd7e6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.080245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1329/2666] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:33 2022] DELETE /identity/v3/users/cc6490250dbe4048aa8c9244f33bd7e6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:34.085040 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.085542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.085542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.105947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:34.107154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:34.121276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:34.171669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1338/2667] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:34.181843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:34.183639 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:34.250870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73456357-76bd-46df-8def-be84dcbbc3a4 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:34.254930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969938a-309a-4c6b-a968-21826e2703e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:34.255687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969938a-309a-4c6b-a968-21826e2703e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.255972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969938a-309a-4c6b-a968-21826e2703e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.256245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969938a-309a-4c6b-a968-21826e2703e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.265836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969938a-309a-4c6b-a968-21826e2703e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:34.267580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969938a-309a-4c6b-a968-21826e2703e3 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:34.277767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1330/2668] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:34.561509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:34.563206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:34.578381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b1f9-9cc2-4077-99dc-6e82874c721b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:34.584625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:34.585857 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.586133 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.586397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] PATH_INFO: `/v3/projects/c7dc3e4d8804438194932520221be410` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.587769 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7dc3e4d8804438194932520221be410)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:34.589666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:34.643370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7dc3e4d8804438194932520221be410', 'request_id': 'req-1c3fc473-c9d4-44f0-8454-67ef6c396499'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.652041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7dc3e4d8804438194932520221be410', 'request_id': 'req-1c3fc473-c9d4-44f0-8454-67ef6c396499'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.658816 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7dc3e4d8804438194932520221be410', 'request_id': 'req-1c3fc473-c9d4-44f0-8454-67ef6c396499'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.675205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] The token cache is being invalidate because project c7dc3e4d8804438194932520221be410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:34.675607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.676348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-1c3fc473-c9d4-44f0-8454-67ef6c396499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:34.678300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1339/2669] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:34 2022] DELETE /identity/v3/projects/c7dc3e4d8804438194932520221be410 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:34.683297 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92557a-67f6-40c8-bf06-da30f08b7245 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.683620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92557a-67f6-40c8-bf06-da30f08b7245 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.683895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92557a-67f6-40c8-bf06-da30f08b7245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.703806 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3b92557a-67f6-40c8-bf06-da30f08b7245 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:34.705377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3b92557a-67f6-40c8-bf06-da30f08b7245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:34.744421 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:34.769388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1331/2670] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:34.778668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925101b6-c0ac-49ea-a000-c0ece4eec1ae None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.779138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925101b6-c0ac-49ea-a000-c0ece4eec1ae None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.779465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925101b6-c0ac-49ea-a000-c0ece4eec1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.800781 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-925101b6-c0ac-49ea-a000-c0ece4eec1ae None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:34.802112 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-925101b6-c0ac-49ea-a000-c0ece4eec1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:34.810252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1340/2671] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:34.814407 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92557a-67f6-40c8-bf06-da30f08b7245 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:34.824461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92557a-67f6-40c8-bf06-da30f08b7245 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:34.829132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:34.829897 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.830232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.830550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.831195 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:34.831498 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:34.833130 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:34.845877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1332/2672] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:34.849859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925101b6-c0ac-49ea-a000-c0ece4eec1ae None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:34.859460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925101b6-c0ac-49ea-a000-c0ece4eec1ae None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:34.864698 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:34.865287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.865575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.865832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.866472 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:34.868402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:34.902649 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1341/2673] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:34 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:34.907207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:34.922364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9356d-cc66-4a0a-bcdb-74f1b68ac458 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:34.993136 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:34.993772 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:34.994053 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:34.994325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:34.994977 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:34.996973 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:35.026703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1333/2674] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:34 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:35.033227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:35.048914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa3f4d-c968-4566-ae4a-d6f5290040e4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:35.054549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:35.055155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:35.055429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:35.055728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:35.056449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:35.058146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:35.069318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1342/2675] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:35.073758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:35.085237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24855cd1-4f90-4a3f-85ba-e4987e0c6fa5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:35.090074 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6b36c-ab4b-490e-b153-fd1abd51ca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:35.090565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b36c-ab4b-490e-b153-fd1abd51ca6c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:35.090845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b36c-ab4b-490e-b153-fd1abd51ca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:35.091119 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6b36c-ab4b-490e-b153-fd1abd51ca6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:35.091795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6b36c-ab4b-490e-b153-fd1abd51ca6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:35.093441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6b36c-ab4b-490e-b153-fd1abd51ca6c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:35.105237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1334/2676] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:35.109843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:35.120501 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cd3f2-e7fc-4757-ac9a-4d71ae50b805 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:35.125162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:35.125811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:35.126086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:35.126659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] PATH_INFO: `/v3/projects/4efe2f8106114267be83d683144d36d4/users/cfc97a75b8f142389470ab7c34f75caa/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:35.141526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efe2f8106114267be83d683144d36d4, user_id=cfc97a75b8f142389470ab7c34f75caa, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:35.144741 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:35.160174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1343/2677] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:35 2022] PUT /identity/v3/projects/4efe2f8106114267be83d683144d36d4/users/cfc97a75b8f142389470ab7c34f75caa/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:35.170851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646659-679e-488c-b366-d528b665414b None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:35.171124 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646659-679e-488c-b366-d528b665414b None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:35.171410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646659-679e-488c-b366-d528b665414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:35.200656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1c646659-679e-488c-b366-d528b665414b None None] MFA Rules not processed for user `cfc97a75b8f142389470ab7c34f75caa`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:35.201872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1c646659-679e-488c-b366-d528b665414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:35.268471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1335/2678] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:35.279634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:35.281447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:35.327521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:35.343941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e6c02-82b7-4132-93ba-175d5e475850 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:35.349178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f63a98-f455-44e8-ab8c-7f6df8f6e65b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:35.349800 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f63a98-f455-44e8-ab8c-7f6df8f6e65b service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:35.350329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f63a98-f455-44e8-ab8c-7f6df8f6e65b service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:35.350607 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f63a98-f455-44e8-ab8c-7f6df8f6e65b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:35.360144 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f63a98-f455-44e8-ab8c-7f6df8f6e65b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:35.361826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f63a98-f455-44e8-ab8c-7f6df8f6e65b service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:35.371062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1344/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:38.847475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646659-679e-488c-b366-d528b665414b None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:38.849001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1c646659-679e-488c-b366-d528b665414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:38.898281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:38.927493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646659-679e-488c-b366-d528b665414b None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:38.932315 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:38.932949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:38.933255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:38.933521 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] PATH_INFO: `/v3/users/f910159e2cd0488f8cdcd13058175cc9` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:38.934649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f910159e2cd0488f8cdcd13058175cc9)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:38.937110 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:38.999333 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f910159e2cd0488f8cdcd13058175cc9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.011781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f910159e2cd0488f8cdcd13058175cc9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.025293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f910159e2cd0488f8cdcd13058175cc9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.026040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f910159e2cd0488f8cdcd13058175cc9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.034353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f910159e2cd0488f8cdcd13058175cc9'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.041070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1336/2680] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:38 2022] DELETE /identity/v3/users/f910159e2cd0488f8cdcd13058175cc9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:39.046715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:39.047252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:39.047675 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:39.078974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:39.080625 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:39.161687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1345/2681] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:39.169720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:39.171680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:39.382637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461a4fa-4a37-4ec7-abbf-6e0e794cf6fb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:39.388533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:39.389160 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:39.389413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:39.389679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:39.401949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:39.403392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:39.413472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1337/2682] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:39.750773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:39.752337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:39.769050 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c4c1e-a8ed-4005-bc12-7bc4ab433970 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:39.775941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:39.776949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:39.777225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:39.777512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] PATH_INFO: `/v3/projects/86ed77f26b5648ecb050e3887ba8971b` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:39.778737 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ed77f26b5648ecb050e3887ba8971b)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:39.781537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:39.843908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ed77f26b5648ecb050e3887ba8971b', 'request_id': 'req-0a2befbf-efa9-419c-9768-001edb13d941'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.855048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ed77f26b5648ecb050e3887ba8971b', 'request_id': 'req-0a2befbf-efa9-419c-9768-001edb13d941'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.862324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ed77f26b5648ecb050e3887ba8971b', 'request_id': 'req-0a2befbf-efa9-419c-9768-001edb13d941'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.878633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] The token cache is being invalidate because project 86ed77f26b5648ecb050e3887ba8971b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:39.878633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.878633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:39.878633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1346/2683] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:39 2022] DELETE /identity/v3/projects/86ed77f26b5648ecb050e3887ba8971b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:39.882398 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:39.892987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a502476-8535-427c-9441-2565e9b8b9d4 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:39.956256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:39.956952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:39.957227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:39.957492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] PATH_INFO: `/v3/users/80ce67560a0f4d69a01137e9fff6c19d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:39.958703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ce67560a0f4d69a01137e9fff6c19d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:39.960632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:39.962258 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:40.018950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ce67560a0f4d69a01137e9fff6c19d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.028679 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ce67560a0f4d69a01137e9fff6c19d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.044002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ce67560a0f4d69a01137e9fff6c19d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.045188 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ce67560a0f4d69a01137e9fff6c19d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.052760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-5e04163c-6f5f-4d44-b294-d91e7687a3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ce67560a0f4d69a01137e9fff6c19d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.059278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1338/2684] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:39 2022] DELETE /identity/v3/users/80ce67560a0f4d69a01137e9fff6c19d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:40.352846 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:40.354974 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:40.376004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2befbf-efa9-419c-9768-001edb13d941 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:40.440718 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:40.441505 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.441901 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.442304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] PATH_INFO: `/v3/projects/1bbe8fdc350a4e36ba5ff16843ccd5db` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.443667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bbe8fdc350a4e36ba5ff16843ccd5db)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:40.445548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:40.454220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:40.496454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bbe8fdc350a4e36ba5ff16843ccd5db', 'request_id': 'req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.505611 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bbe8fdc350a4e36ba5ff16843ccd5db', 'request_id': 'req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.512503 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bbe8fdc350a4e36ba5ff16843ccd5db', 'request_id': 'req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.523702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] The token cache is being invalidate because project 1bbe8fdc350a4e36ba5ff16843ccd5db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:40.524109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.524973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-ba6254eb-7cfe-4f25-8cd8-50395aed5b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:40.526529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1347/2685] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:40 2022] DELETE /identity/v3/projects/1bbe8fdc350a4e36ba5ff16843ccd5db => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:40.531592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83182e65-84ec-414b-879f-fe68b563cb6c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.531991 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83182e65-84ec-414b-879f-fe68b563cb6c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.532325 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83182e65-84ec-414b-879f-fe68b563cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.552958 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-83182e65-84ec-414b-879f-fe68b563cb6c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:40.554166 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-83182e65-84ec-414b-879f-fe68b563cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:40.614816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1339/2686] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:40.622888 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d654c-2e07-469d-9aad-735a6f977ecb None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.623177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d654c-2e07-469d-9aad-735a6f977ecb None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.623458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d654c-2e07-469d-9aad-735a6f977ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.643806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-811d654c-2e07-469d-9aad-735a6f977ecb None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:40.645029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-811d654c-2e07-469d-9aad-735a6f977ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:40.653197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1348/2687] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:40.657610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83182e65-84ec-414b-879f-fe68b563cb6c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:40.668247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83182e65-84ec-414b-879f-fe68b563cb6c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:40.673520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:40.674126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.674457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.674730 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.675475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:40.675677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:40.677334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:40.689592 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1340/2688] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:40.694011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d654c-2e07-469d-9aad-735a6f977ecb None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:40.703454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d654c-2e07-469d-9aad-735a6f977ecb None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:40.708433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:40.709072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.709344 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.709609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.710251 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:40.712217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:40.746377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1349/2689] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:40 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:40.746516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:40.757835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a58e6-39d7-4744-b27d-3bda753262ca admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:40.818882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:40.819505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.819817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.820091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.820724 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:40.822744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:40.834744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:40.851941 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1341/2690] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:40 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:40.853475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:40.864076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a659-9748-4d72-9bf8-93a8782b9ba0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:40.868996 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:40.869680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.870028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.870368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.871088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:40.872791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:40.883410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1350/2691] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:40.887581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:40.898417 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ec817-c8c8-484f-aa1c-20c6636ed1d3 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:40.903225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ebc8b-5c97-4c8a-ad75-839e6dc20025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:40.903942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ebc8b-5c97-4c8a-ad75-839e6dc20025 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.904223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ebc8b-5c97-4c8a-ad75-839e6dc20025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.904492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ebc8b-5c97-4c8a-ad75-839e6dc20025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.905158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ebc8b-5c97-4c8a-ad75-839e6dc20025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:40.906771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8ebc8b-5c97-4c8a-ad75-839e6dc20025 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:40.920472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1342/2692] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:40.921593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:40.931924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c5eed-6a63-4051-9385-568efcde4f0f admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:40.936520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:40.937176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.937458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.937733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] PATH_INFO: `/v3/projects/20b5b807f9ce4fc9b2fe51b0406a8d47/users/9820ab4e061840928ccb81253a3385e2/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:40.952442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b5b807f9ce4fc9b2fe51b0406a8d47, user_id=9820ab4e061840928ccb81253a3385e2, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:40.955098 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:40.970380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1351/2693] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:40 2022] PUT /identity/v3/projects/20b5b807f9ce4fc9b2fe51b0406a8d47/users/9820ab4e061840928ccb81253a3385e2/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:40.981658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b60d-35bb-4812-bc9b-8d5c37ee271c None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:40.981926 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b60d-35bb-4812-bc9b-8d5c37ee271c None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:40.982192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6b60d-35bb-4812-bc9b-8d5c37ee271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.012043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-1fb6b60d-35bb-4812-bc9b-8d5c37ee271c None None] MFA Rules not processed for user `9820ab4e061840928ccb81253a3385e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:41.013268 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1fb6b60d-35bb-4812-bc9b-8d5c37ee271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:41.088227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1343/2694] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:41.093405 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.158828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276dc1e-fb58-46e4-9ce5-226e7a28f437 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.164328 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.164945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.165223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.165493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.166127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.168048 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.201835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1352/2695] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:41 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:41.202987 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b60d-35bb-4812-bc9b-8d5c37ee271c None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.214086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6b60d-35bb-4812-bc9b-8d5c37ee271c None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.274937 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.275848 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.276135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.276409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.277186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.279104 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.308026 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1344/2696] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:41 2022] POST /identity/v3/users => generated 306 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:41.309263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.319866 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ffac6-63d5-4d95-b6e6-32c6846cfd05 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.325067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.325664 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.325935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.326333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.327121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.328736 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.343198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1353/2697] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:41.345057 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.357505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f196d5-4c42-4df4-a4dc-2f8dd4a7b576 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.365051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.365711 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.365989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.366256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] PATH_INFO: `/v3/projects/55ad82a3d6dc49558c6531af3e13269a/users/f86c55d29ed5456f89349dd2445b73bc/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.381698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ad82a3d6dc49558c6531af3e13269a, user_id=f86c55d29ed5456f89349dd2445b73bc, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.384379 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.399158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1345/2698] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:41 2022] PUT /identity/v3/projects/55ad82a3d6dc49558c6531af3e13269a/users/f86c55d29ed5456f89349dd2445b73bc/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:41.403282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.414207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a09e4-27af-41b5-a67a-c16dc3cb76f9 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.418382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:41.479971 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c8807-6367-40fe-86fb-61480efd3635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.480589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8807-6367-40fe-86fb-61480efd3635 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.480869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8807-6367-40fe-86fb-61480efd3635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.481246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c8807-6367-40fe-86fb-61480efd3635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.481911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c8807-6367-40fe-86fb-61480efd3635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.483502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c8807-6367-40fe-86fb-61480efd3635 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.495569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1354/2699] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:41.498432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.509616 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef56706-6ca2-445c-b189-8bf5b1868e80 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.514603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.515260 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.515536 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.515843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] PATH_INFO: `/v3/projects/55ad82a3d6dc49558c6531af3e13269a/users/f86c55d29ed5456f89349dd2445b73bc/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.517963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ad82a3d6dc49558c6531af3e13269a, user_id=f86c55d29ed5456f89349dd2445b73bc, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.520740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.531713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1346/2700] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:41 2022] PUT /identity/v3/projects/55ad82a3d6dc49558c6531af3e13269a/users/f86c55d29ed5456f89349dd2445b73bc/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:41.543509 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52ef56-cbc2-4e09-8949-9f1dc78bba1e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.543908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52ef56-cbc2-4e09-8949-9f1dc78bba1e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.544249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52ef56-cbc2-4e09-8949-9f1dc78bba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.574313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-bc52ef56-cbc2-4e09-8949-9f1dc78bba1e None None] MFA Rules not processed for user `f86c55d29ed5456f89349dd2445b73bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:41.575473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bc52ef56-cbc2-4e09-8949-9f1dc78bba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:41.644057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1355/2701] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:41 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:41.655502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.657385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:41.690823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:41.719819 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6fb9b-161e-4d9c-a2ab-c9a647851fd9 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.723974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.724651 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.724907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.725179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.734453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.736006 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.745664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1347/2702] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:41.829138 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52ef56-cbc2-4e09-8949-9f1dc78bba1e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:41.838925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52ef56-cbc2-4e09-8949-9f1dc78bba1e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:41.842502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f1bbe-19cf-4ad2-96af-d0ae39585278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:41.843107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f1bbe-19cf-4ad2-96af-d0ae39585278 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:41.843387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f1bbe-19cf-4ad2-96af-d0ae39585278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:41.843704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f1bbe-19cf-4ad2-96af-d0ae39585278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:41.908475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f1bbe-19cf-4ad2-96af-d0ae39585278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:41.909907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f1bbe-19cf-4ad2-96af-d0ae39585278 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:41.920312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1356/2703] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:45.494190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:45.495797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:45.568048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921c1e9-1c80-4b89-8c70-03c64f4a9e11 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:45.573664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:45.574307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:45.574588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:45.574858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] PATH_INFO: `/v3/users/cfc97a75b8f142389470ab7c34f75caa` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:45.576134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc97a75b8f142389470ab7c34f75caa)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:45.578109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:45.634356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc97a75b8f142389470ab7c34f75caa'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:45.642610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc97a75b8f142389470ab7c34f75caa'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:45.656605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc97a75b8f142389470ab7c34f75caa'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:45.657820 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc97a75b8f142389470ab7c34f75caa'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:45.667908 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc97a75b8f142389470ab7c34f75caa'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:45.674271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1348/2704] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:45 2022] DELETE /identity/v3/users/cfc97a75b8f142389470ab7c34f75caa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:45.678992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:45.679536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:45.679665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:45.699376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:45.700640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:45.720935 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:45.769614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1357/2705] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:45.777434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:45.779271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:45.835956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:45.840759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ade3ce-4685-4a30-966b-77078b9405a7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:45.846111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:45.846733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:45.847015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:45.847389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:45.858540 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:45.860089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:45.869736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1349/2706] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:39:46.094161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:46.095623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:46.107889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb2329-b2cb-4966-9251-73939332e1a8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:46.112793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:46.113425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:46.113705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:46.113976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] PATH_INFO: `/v3/users/9820ab4e061840928ccb81253a3385e2` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:46.115316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9820ab4e061840928ccb81253a3385e2)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:46.117333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:46.152936 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:46.154475 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:46.170288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a327c-13d1-4490-b2eb-312d365a45f4 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:46.178278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:46.178910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:46.179196 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:46.179471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] PATH_INFO: `/v3/projects/4efe2f8106114267be83d683144d36d4` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:46.180775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efe2f8106114267be83d683144d36d4)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:46.182747 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:46.186327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9820ab4e061840928ccb81253a3385e2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.196757 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9820ab4e061840928ccb81253a3385e2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.198458 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9820ab4e061840928ccb81253a3385e2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.210484 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9820ab4e061840928ccb81253a3385e2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.224091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-12f37512-fd8e-4f4a-a0ee-ba69b4040811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9820ab4e061840928ccb81253a3385e2'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.231161 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1358/2707] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:46 2022] DELETE /identity/v3/users/9820ab4e061840928ccb81253a3385e2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:46.235659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:46.235977 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:46.236287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:46.241334 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efe2f8106114267be83d683144d36d4', 'request_id': 'req-38716a21-499e-4dcb-b37b-4d0aa6ca5803'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.247295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efe2f8106114267be83d683144d36d4', 'request_id': 'req-38716a21-499e-4dcb-b37b-4d0aa6ca5803'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.253935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efe2f8106114267be83d683144d36d4', 'request_id': 'req-38716a21-499e-4dcb-b37b-4d0aa6ca5803'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.255722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:46.257017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:46.267141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] The token cache is being invalidate because project 4efe2f8106114267be83d683144d36d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:46.267434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.268072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.269786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1350/2708] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:46 2022] DELETE /identity/v3/projects/4efe2f8106114267be83d683144d36d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:46.321627 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1359/2709] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:46.331913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:46.333508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:46.399451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38716a21-499e-4dcb-b37b-4d0aa6ca5803 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:46.454562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:46.455194 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:46.455474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:46.455794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:46.466061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:46.467563 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:46.478968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1351/2710] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:46.758259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:46.759817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:46.772981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f6e2f-207c-46d7-82ab-3563a9878d54 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:46.778659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:46.779933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:46.780442 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:46.780814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] PATH_INFO: `/v3/projects/20b5b807f9ce4fc9b2fe51b0406a8d47` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:46.782206 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b5b807f9ce4fc9b2fe51b0406a8d47)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:46.784327 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:46.823334 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:46.835008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b5b807f9ce4fc9b2fe51b0406a8d47', 'request_id': 'req-596eecae-9345-4dc8-90c5-b5fbd57f40d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.843404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b5b807f9ce4fc9b2fe51b0406a8d47', 'request_id': 'req-596eecae-9345-4dc8-90c5-b5fbd57f40d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.850215 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b5b807f9ce4fc9b2fe51b0406a8d47', 'request_id': 'req-596eecae-9345-4dc8-90c5-b5fbd57f40d5'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.864659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] The token cache is being invalidate because project 20b5b807f9ce4fc9b2fe51b0406a8d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:46.864945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.865569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:46.867044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1360/2711] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:46 2022] DELETE /identity/v3/projects/20b5b807f9ce4fc9b2fe51b0406a8d47 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:46.871429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:46.886708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669d90-38da-4236-be57-78f60241ed82 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:46.922215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:46.950396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:46.951024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:46.951317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:46.951589 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] PATH_INFO: `/v3/users/f86c55d29ed5456f89349dd2445b73bc` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:46.952847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86c55d29ed5456f89349dd2445b73bc)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:46.954746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.007338 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86c55d29ed5456f89349dd2445b73bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.016442 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86c55d29ed5456f89349dd2445b73bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.029014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86c55d29ed5456f89349dd2445b73bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.029715 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86c55d29ed5456f89349dd2445b73bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.036661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f1f138ec-750d-4964-acea-3233bb227050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86c55d29ed5456f89349dd2445b73bc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.042519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1352/2712] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:46 2022] DELETE /identity/v3/users/f86c55d29ed5456f89349dd2445b73bc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:47.329738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:47.331294 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:47.348216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eecae-9345-4dc8-90c5-b5fbd57f40d5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:47.414575 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:47.415207 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.415475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.415778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] PATH_INFO: `/v3/projects/55ad82a3d6dc49558c6531af3e13269a` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.416930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ad82a3d6dc49558c6531af3e13269a)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:47.418856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.471709 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ad82a3d6dc49558c6531af3e13269a', 'request_id': 'req-006ed2df-98db-44d4-b7f8-23c2f6493682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.480515 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ad82a3d6dc49558c6531af3e13269a', 'request_id': 'req-006ed2df-98db-44d4-b7f8-23c2f6493682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.487316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ad82a3d6dc49558c6531af3e13269a', 'request_id': 'req-006ed2df-98db-44d4-b7f8-23c2f6493682'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.499958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] The token cache is being invalidate because project 55ad82a3d6dc49558c6531af3e13269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:47.500248 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.500952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-006ed2df-98db-44d4-b7f8-23c2f6493682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:47.502506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1361/2713] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:47 2022] DELETE /identity/v3/projects/55ad82a3d6dc49558c6531af3e13269a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:47.508380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845bc71-f374-4edd-b157-a247ddd3a0f1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.508753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845bc71-f374-4edd-b157-a247ddd3a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.509118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845bc71-f374-4edd-b157-a247ddd3a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.529984 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3845bc71-f374-4edd-b157-a247ddd3a0f1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:47.531322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3845bc71-f374-4edd-b157-a247ddd3a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:47.594219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1353/2714] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:47.602190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8fdfd-1698-4bbf-96bd-1f4d5edddd25 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.602473 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8fdfd-1698-4bbf-96bd-1f4d5edddd25 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.602748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8fdfd-1698-4bbf-96bd-1f4d5edddd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.623798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-b3c8fdfd-1698-4bbf-96bd-1f4d5edddd25 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:47.624939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b3c8fdfd-1698-4bbf-96bd-1f4d5edddd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:47.633209 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1362/2715] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:47.637591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845bc71-f374-4edd-b157-a247ddd3a0f1 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:47.647674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845bc71-f374-4edd-b157-a247ddd3a0f1 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:47.652708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:47.653317 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.653598 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.653870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.654548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:47.654855 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:47.656512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.668185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1354/2716] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:47.672912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8fdfd-1698-4bbf-96bd-1f4d5edddd25 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:47.682574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8fdfd-1698-4bbf-96bd-1f4d5edddd25 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:47.687651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:47.688242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.688520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.688813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.689589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:47.691474 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.724047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1363/2717] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:47 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:47.725410 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:47.735966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca858-0366-493f-9a78-51cb62c8fb7c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:47.776990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:47.798065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:47.798674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.798945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.799211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.799887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:47.801882 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.824096 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1355/2718] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:47 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:47.828417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:47.839047 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf45eca-acae-4180-a5f8-d3a5285b71c5 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:47.843833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:47.844447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.844724 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.844994 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.845669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:47.847242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.858316 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1364/2719] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:47.862223 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:47.872942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a230a-536d-47c3-b92d-edeb75ec09ec admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:47.877853 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6ebd0-2e6d-49fe-8e52-b5e1826ee4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:47.878401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ebd0-2e6d-49fe-8e52-b5e1826ee4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.878680 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ebd0-2e6d-49fe-8e52-b5e1826ee4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.878954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6ebd0-2e6d-49fe-8e52-b5e1826ee4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.879632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6ebd0-2e6d-49fe-8e52-b5e1826ee4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:47.881419 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6ebd0-2e6d-49fe-8e52-b5e1826ee4d7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.893055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1356/2720] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:47.896906 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:47.907298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d3a32-c789-41d1-9566-06ef53ca3f21 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:47.912785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:47.913464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.913738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.914016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] PATH_INFO: `/v3/projects/8045f8663ac84614956a9076cb261f24/users/6f6e646d0907431d915cbe141a9931f6/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.925650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:47.929783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8045f8663ac84614956a9076cb261f24, user_id=6f6e646d0907431d915cbe141a9931f6, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:47.932956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:47.949693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1365/2721] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:47 2022] PUT /identity/v3/projects/8045f8663ac84614956a9076cb261f24/users/6f6e646d0907431d915cbe141a9931f6/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:47.960541 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:47.960935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:47.961271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:47.989927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] MFA Rules not processed for user `6f6e646d0907431d915cbe141a9931f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:47.991143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:48.056281 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1357/2722] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:48.067763 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:48.069656 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:48.131157 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed513ce2-dfb0-4772-8a2e-0f2f9a12f55b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:48.134797 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:48.135407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:48.135702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:48.135973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:48.144837 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:48.146452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:48.156305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1366/2723] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:52.746085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:52.747578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:52.815505 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a7668-199d-493d-be6a-e14aeb0a5f78 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:52.819151 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:52.819786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:52.820134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:52.820751 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:52.822159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:52.888643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:52.890094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:52.894138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:52.901526 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1358/2724] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:56.166692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:56.169253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:56.189181 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5061b8-e0c8-4dcd-8332-7662942ddc10 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:56.198177 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:56.198835 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:56.199113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:56.199386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] PATH_INFO: `/v3/users/aa1bc77ffe9245c8b1c8fa0ede1874b9` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:56.215135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1bc77ffe9245c8b1c8fa0ede1874b9)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:56.217337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:56.267565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1bc77ffe9245c8b1c8fa0ede1874b9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.276358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1bc77ffe9245c8b1c8fa0ede1874b9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.276956 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1bc77ffe9245c8b1c8fa0ede1874b9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.284078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1bc77ffe9245c8b1c8fa0ede1874b9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.304471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a2a5949d-0f5d-45ed-b41f-b3d6e2a52ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1bc77ffe9245c8b1c8fa0ede1874b9'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.310944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1367/2725] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:56 2022] DELETE /identity/v3/users/aa1bc77ffe9245c8b1c8fa0ede1874b9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:56.495469 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:56.506887 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1755afc-3254-467e-b68d-870ffbd998e9 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:56.569340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:56.569969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:56.570266 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:56.570606 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] PATH_INFO: `/v3/projects/3197f5ea54a24137b01f2288aea20dd6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:56.581754 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3197f5ea54a24137b01f2288aea20dd6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:56.583693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:56.635144 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3197f5ea54a24137b01f2288aea20dd6', 'request_id': 'req-74801975-ceb3-4dec-9f4b-39f558530925'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.641017 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3197f5ea54a24137b01f2288aea20dd6', 'request_id': 'req-74801975-ceb3-4dec-9f4b-39f558530925'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.647944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3197f5ea54a24137b01f2288aea20dd6', 'request_id': 'req-74801975-ceb3-4dec-9f4b-39f558530925'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.662872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] The token cache is being invalidate because project 3197f5ea54a24137b01f2288aea20dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:56.663157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.663834 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-74801975-ceb3-4dec-9f4b-39f558530925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:56.665392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1359/2726] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:56 2022] DELETE /identity/v3/projects/3197f5ea54a24137b01f2288aea20dd6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:56.670845 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47b664-afd0-49bb-80c5-d902a9d24f39 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:56.671125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47b664-afd0-49bb-80c5-d902a9d24f39 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:56.671394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47b664-afd0-49bb-80c5-d902a9d24f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:56.692500 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-1f47b664-afd0-49bb-80c5-d902a9d24f39 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:56.693640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1f47b664-afd0-49bb-80c5-d902a9d24f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:56.746059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:56.762004 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1368/2727] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:56.770051 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3faa2-432c-4a0b-9971-be8c45c1d7d0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:56.770336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3faa2-432c-4a0b-9971-be8c45c1d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:56.770668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3faa2-432c-4a0b-9971-be8c45c1d7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:56.790856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f6e3faa2-432c-4a0b-9971-be8c45c1d7d0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:56.792098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f6e3faa2-432c-4a0b-9971-be8c45c1d7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:56.801007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1360/2728] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:56.805377 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47b664-afd0-49bb-80c5-d902a9d24f39 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:56.815309 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47b664-afd0-49bb-80c5-d902a9d24f39 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:56.820531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:56.821128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:56.821390 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:56.821808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:56.822460 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:56.822760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:56.824385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:56.836179 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1369/2729] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:56.841186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3faa2-432c-4a0b-9971-be8c45c1d7d0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:56.854699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3faa2-432c-4a0b-9971-be8c45c1d7d0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:56.860644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:56.861241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:56.861517 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:56.861783 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:56.862396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:56.864337 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:56.896049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1361/2730] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:56 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:56.900451 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:56.910471 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d644756-45e3-4ada-a15e-a439f1fa561c admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:56.974079 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:56.974694 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:56.974966 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:56.975245 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:56.975916 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:56.978115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:56.999922 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1370/2731] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:56 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:57.004032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.015359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88224e5-eec4-418d-9d78-32efb505e951 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.021821 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.022533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.022880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.023292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.024235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.025914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.036735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1362/2732] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:57.041011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.052479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325d362-9dc7-44fb-a723-c7ec98d970ae admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.057772 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e5204-d4e9-4216-9847-06f33f4786da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.058385 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e5204-d4e9-4216-9847-06f33f4786da admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.058660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e5204-d4e9-4216-9847-06f33f4786da admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.058942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e5204-d4e9-4216-9847-06f33f4786da admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.059576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e5204-d4e9-4216-9847-06f33f4786da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.061182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e5204-d4e9-4216-9847-06f33f4786da admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.073063 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1371/2733] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:57.077914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.089245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37217249-37c2-428f-ab4c-5bc2b729d67d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.094098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.094755 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.095035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.095307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] PATH_INFO: `/v3/projects/9a03508f8c11411597684416a08d5a78/users/5be4163516e347b0a9182f6a55354b37/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.110137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a03508f8c11411597684416a08d5a78, user_id=5be4163516e347b0a9182f6a55354b37, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.112850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.129304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1363/2734] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:57 2022] PUT /identity/v3/projects/9a03508f8c11411597684416a08d5a78/users/5be4163516e347b0a9182f6a55354b37/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:57.141576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cee18-51bb-46a5-98d3-0e095a398afe None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.141868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cee18-51bb-46a5-98d3-0e095a398afe None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.142293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310cee18-51bb-46a5-98d3-0e095a398afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.177317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-310cee18-51bb-46a5-98d3-0e095a398afe None None] MFA Rules not processed for user `5be4163516e347b0a9182f6a55354b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:57.178683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-310cee18-51bb-46a5-98d3-0e095a398afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:57.263783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1372/2735] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:57.268970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.300087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:57.349113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa5b0-8c56-49da-8da7-d7ebfc6c41fb admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.353942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.354630 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.354911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.355182 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.355863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.357846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.386356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1364/2736] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:57 2022] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:57.390504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cee18-51bb-46a5-98d3-0e095a398afe None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.401687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310cee18-51bb-46a5-98d3-0e095a398afe None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.450588 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:57.468231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.469146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.469541 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.469942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.470925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.474031 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.499263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1373/2737] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:57 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:57.504413 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.517090 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553b713-f2f5-463c-b04d-e6d617cd001e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.522213 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.522807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.523082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.523387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.524584 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.526184 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.537464 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1365/2738] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:57.542267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.556571 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65191fb-87c1-42ea-bd2d-40e99679cab0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.562885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.563563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.563869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.564142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] PATH_INFO: `/v3/projects/0af4f55aea984e12be43b6eb54dc8795/users/185d20812cc340629ebaa7dfa11b09bb/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.580045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af4f55aea984e12be43b6eb54dc8795, user_id=185d20812cc340629ebaa7dfa11b09bb, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.582704 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.598176 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1374/2739] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:57 2022] PUT /identity/v3/projects/0af4f55aea984e12be43b6eb54dc8795/users/185d20812cc340629ebaa7dfa11b09bb/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:57.602816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.612779 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98872d9-7127-4bb6-9978-5dfbb7f3fe51 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.671814 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb26a-21c6-481e-8914-d719ba0baef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.672415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb26a-21c6-481e-8914-d719ba0baef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.672693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb26a-21c6-481e-8914-d719ba0baef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.672955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb26a-21c6-481e-8914-d719ba0baef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.673575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb26a-21c6-481e-8914-d719ba0baef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.675170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb26a-21c6-481e-8914-d719ba0baef0 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.685231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1366/2740] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:57.689813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.701082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9394f25-f7a0-446c-bf35-5398b4da3a4e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.707338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.708026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.708299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.708563 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] PATH_INFO: `/v3/projects/0af4f55aea984e12be43b6eb54dc8795/users/185d20812cc340629ebaa7dfa11b09bb/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.710779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af4f55aea984e12be43b6eb54dc8795, user_id=185d20812cc340629ebaa7dfa11b09bb, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.715142 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.731288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1375/2741] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:57 2022] PUT /identity/v3/projects/0af4f55aea984e12be43b6eb54dc8795/users/185d20812cc340629ebaa7dfa11b09bb/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:57.745459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aba4b-7567-469c-8527-6b126271bd26 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.745763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aba4b-7567-469c-8527-6b126271bd26 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.746008 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8aba4b-7567-469c-8527-6b126271bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.775308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-fe8aba4b-7567-469c-8527-6b126271bd26 None None] MFA Rules not processed for user `185d20812cc340629ebaa7dfa11b09bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:57.776569 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-fe8aba4b-7567-469c-8527-6b126271bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:57.844383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1367/2742] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:57.855973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:57.857907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:57.916813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e1a06-68ac-4759-a202-2a22e64c8b40 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:57.921074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c804e-5e54-4f5b-a04d-b9778deb8a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:57.921676 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c804e-5e54-4f5b-a04d-b9778deb8a02 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:57.921954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c804e-5e54-4f5b-a04d-b9778deb8a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:57.922242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c804e-5e54-4f5b-a04d-b9778deb8a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:57.932651 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c804e-5e54-4f5b-a04d-b9778deb8a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:57.934941 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c804e-5e54-4f5b-a04d-b9778deb8a02 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:57.950493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1376/2743] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:57 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:58.111071 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aba4b-7567-469c-8527-6b126271bd26 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:58.125158 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:58.177898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8aba4b-7567-469c-8527-6b126271bd26 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:58.182836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:58.183474 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:58.183781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:58.184078 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] PATH_INFO: `/v3/users/5be4163516e347b0a9182f6a55354b37` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:58.185224 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be4163516e347b0a9182f6a55354b37)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:58.187152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:58.239079 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be4163516e347b0a9182f6a55354b37'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.248001 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be4163516e347b0a9182f6a55354b37'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.260732 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be4163516e347b0a9182f6a55354b37'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.261420 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be4163516e347b0a9182f6a55354b37'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.268200 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be4163516e347b0a9182f6a55354b37'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.275264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1368/2744] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:58 2022] DELETE /identity/v3/users/5be4163516e347b0a9182f6a55354b37 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:58.280101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:58.280632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:58.280632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:58.301476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:58.302703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:58.369397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1377/2745] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:39:58.379720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:58.381264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:58.441094 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0196ca-17a5-432f-8c97-6b07773aef82 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:58.444778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:58.445387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:58.445665 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:58.446148 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:58.456217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:58.457663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:58.468361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1369/2746] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:58.754988 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:58.756439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:58.768876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d409e31-871c-4cff-8419-7b050d030bd4 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:58.775409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:58.776102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:58.776379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:58.776633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] PATH_INFO: `/v3/projects/9a03508f8c11411597684416a08d5a78` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:58.777920 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a03508f8c11411597684416a08d5a78)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:58.779861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:58.824393 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:58.832380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a03508f8c11411597684416a08d5a78', 'request_id': 'req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.841256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a03508f8c11411597684416a08d5a78', 'request_id': 'req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.847660 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a03508f8c11411597684416a08d5a78', 'request_id': 'req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.858878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] The token cache is being invalidate because project 9a03508f8c11411597684416a08d5a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:58.859174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.859936 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.861734 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1378/2747] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:58 2022] DELETE /identity/v3/projects/9a03508f8c11411597684416a08d5a78 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:58.865913 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:58.876833 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7168d8-e1cb-40e3-9a08-c29be50aa539 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:58.907129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:58.936961 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:58.937599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:58.937876 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:58.938150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] PATH_INFO: `/v3/users/185d20812cc340629ebaa7dfa11b09bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:58.939261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=185d20812cc340629ebaa7dfa11b09bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:58.941231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:58.990507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185d20812cc340629ebaa7dfa11b09bb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:58.999798 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185d20812cc340629ebaa7dfa11b09bb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.012520 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185d20812cc340629ebaa7dfa11b09bb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.013169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185d20812cc340629ebaa7dfa11b09bb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.019934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2aa000b9-63cb-46d4-aee8-e9569b368766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185d20812cc340629ebaa7dfa11b09bb'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.026233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1370/2748] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:39:58 2022] DELETE /identity/v3/users/185d20812cc340629ebaa7dfa11b09bb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:59.322252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:59.323829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:59.338354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0717-adf6-4ff4-8c4b-58c650a264bc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:59.398135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:59.398761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.399211 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.399702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] PATH_INFO: `/v3/projects/0af4f55aea984e12be43b6eb54dc8795` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.400861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af4f55aea984e12be43b6eb54dc8795)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:59.402761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:59.458613 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af4f55aea984e12be43b6eb54dc8795', 'request_id': 'req-04816eed-dbde-42d7-9036-92d0426c25d6'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.468852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af4f55aea984e12be43b6eb54dc8795', 'request_id': 'req-04816eed-dbde-42d7-9036-92d0426c25d6'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.475591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af4f55aea984e12be43b6eb54dc8795', 'request_id': 'req-04816eed-dbde-42d7-9036-92d0426c25d6'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.487286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] The token cache is being invalidate because project 0af4f55aea984e12be43b6eb54dc8795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:39:59.487662 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.488335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-04816eed-dbde-42d7-9036-92d0426c25d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:39:59.489862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1379/2749] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:39:59 2022] DELETE /identity/v3/projects/0af4f55aea984e12be43b6eb54dc8795 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:39:59.495952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc76d-9009-490f-865c-9f570d38e988 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.496242 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc76d-9009-490f-865c-9f570d38e988 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.496519 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc76d-9009-490f-865c-9f570d38e988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.516573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6fecc76d-9009-490f-865c-9f570d38e988 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:59.517703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6fecc76d-9009-490f-865c-9f570d38e988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:59.577218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1371/2750] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:59.585204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b6d3-ce1b-48bf-810a-53b060e9d593 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.585495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b6d3-ce1b-48bf-810a-53b060e9d593 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.585793 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b6d3-ce1b-48bf-810a-53b060e9d593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.607828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0ec0b6d3-ce1b-48bf-810a-53b060e9d593 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:59.609051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0ec0b6d3-ce1b-48bf-810a-53b060e9d593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:59.618082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1380/2751] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:59.622707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc76d-9009-490f-865c-9f570d38e988 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:59.632775 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc76d-9009-490f-865c-9f570d38e988 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:59.638153 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:59.638767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.639043 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.639341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.640137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:39:59.640444 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:59.642092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:59.654574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1372/2752] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:39:59.663601 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b6d3-ce1b-48bf-810a-53b060e9d593 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:59.669028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b6d3-ce1b-48bf-810a-53b060e9d593 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:59.674434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:59.675085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.675085 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.675354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.676042 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:59.677963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:59.713234 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1381/2753] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:39:59 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:39:59.714694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:59.724640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8a470-b083-49b0-b719-fff4b8807b42 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:59.767245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:59.789288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:59.790000 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.790292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.790565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.791215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:59.793193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:59.816341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1373/2754] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:39:59 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:39:59.820502 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:59.830729 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a1169-8805-4593-ab8b-88e779812ea6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:59.835512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:59.836168 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.836645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.837216 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.837591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:59.839261 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:59.849402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1382/2755] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:59.853553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:59.863797 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476809fe-395f-4987-8eb6-bd2baa7614ff admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:59.868562 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f337d67-e5ea-4b52-955d-be16cdb69edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:59.869204 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f337d67-e5ea-4b52-955d-be16cdb69edf admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.869570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f337d67-e5ea-4b52-955d-be16cdb69edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.869850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f337d67-e5ea-4b52-955d-be16cdb69edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.870659 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f337d67-e5ea-4b52-955d-be16cdb69edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:59.872636 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f337d67-e5ea-4b52-955d-be16cdb69edf admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:59.885629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1374/2756] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:39:59.890131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:59.901372 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ef4b2-b1ae-4388-a9d4-965c121e1a1e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:59.906695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:59.907380 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.907732 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.908148 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] PATH_INFO: `/v3/projects/0cb9ccb71e9748878095d836eec40fc8/users/410e4e4fb932482ca6a549e59b342a95/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.924381 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb9ccb71e9748878095d836eec40fc8, user_id=410e4e4fb932482ca6a549e59b342a95, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:59.927034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:59.929220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:59.942812 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1383/2757] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:39:59 2022] PUT /identity/v3/projects/0cb9ccb71e9748878095d836eec40fc8/users/410e4e4fb932482ca6a549e59b342a95/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:39:59.954809 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccebb02-ba39-49e8-b8cc-ffbadea6f858 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:59.955061 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccebb02-ba39-49e8-b8cc-ffbadea6f858 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:59.955355 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccebb02-ba39-49e8-b8cc-ffbadea6f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:59.985210 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-dccebb02-ba39-49e8-b8cc-ffbadea6f858 None None] MFA Rules not processed for user `410e4e4fb932482ca6a549e59b342a95`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:59.986437 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-dccebb02-ba39-49e8-b8cc-ffbadea6f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:00.056431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1375/2758] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:00.061049 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.122775 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a100cd6-bbd1-48e1-a57a-d845c5ecb8ab admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.128521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.129139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.129419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.129685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.130326 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.132291 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.163171 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1384/2759] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:00.167664 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccebb02-ba39-49e8-b8cc-ffbadea6f858 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.182759 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccebb02-ba39-49e8-b8cc-ffbadea6f858 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.252397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.253073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.253360 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.253632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.254264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.256241 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.280851 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1376/2760] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:00 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:00.285092 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.296555 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699c958-31bf-402b-88fe-5e5df7cf920d admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.301668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.302276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.302580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.302844 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.303487 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.305313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.316542 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1385/2761] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:00.321142 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.332725 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6da7b-68f3-484c-9534-2ff95d634bdc admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.337709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.338363 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.338643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.338919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] PATH_INFO: `/v3/projects/0deef76407424c0a99eb8a1a07c373db/users/8f40465e65d243b58e02c07ca5a77ef8/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.354487 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0deef76407424c0a99eb8a1a07c373db, user_id=8f40465e65d243b58e02c07ca5a77ef8, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.357192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.373593 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1377/2762] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:00 2022] PUT /identity/v3/projects/0deef76407424c0a99eb8a1a07c373db/users/8f40465e65d243b58e02c07ca5a77ef8/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:00.377684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.388630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc13e05-a753-4b19-8070-373eb0068f93 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.450615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a938748-137e-48af-9602-f85a3fb8d705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.451222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938748-137e-48af-9602-f85a3fb8d705 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.451499 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938748-137e-48af-9602-f85a3fb8d705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.451798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a938748-137e-48af-9602-f85a3fb8d705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.452434 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a938748-137e-48af-9602-f85a3fb8d705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.454282 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a938748-137e-48af-9602-f85a3fb8d705 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.466753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1386/2763] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:00.471243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.482612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffa588-c595-4260-8261-a64c1befe9ed admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.487674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.488326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.488605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.488875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] PATH_INFO: `/v3/projects/0deef76407424c0a99eb8a1a07c373db/users/8f40465e65d243b58e02c07ca5a77ef8/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.490891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0deef76407424c0a99eb8a1a07c373db, user_id=8f40465e65d243b58e02c07ca5a77ef8, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.494105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.500771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:00.505272 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1378/2764] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:00 2022] PUT /identity/v3/projects/0deef76407424c0a99eb8a1a07c373db/users/8f40465e65d243b58e02c07ca5a77ef8/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:00.516445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.516735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.517015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.546429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] MFA Rules not processed for user `8f40465e65d243b58e02c07ca5a77ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:00.547577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:00.607576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:00.628115 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1387/2765] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:00.640365 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.642214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:00.702807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6b980-550e-43c4-9dd6-8c9a3777dd4b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.706950 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.707642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.707877 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.708149 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.717786 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.719237 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.728944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1379/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:00.835389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.838852 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:00.852204 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b38ee-34d2-4092-8b3c-c0ce26827921 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:00.856398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e523a-8c28-48ac-ab03-09e9095facc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:00.857034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e523a-8c28-48ac-ab03-09e9095facc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:00.857293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e523a-8c28-48ac-ab03-09e9095facc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:00.857559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e523a-8c28-48ac-ab03-09e9095facc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:00.921320 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e523a-8c28-48ac-ab03-09e9095facc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:00.922764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e523a-8c28-48ac-ab03-09e9095facc5 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:00.932792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1388/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:00.952091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:00.953545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:01.018879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5fda8-ab51-4390-be1c-ebcdd3e2b3fc service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:01.025036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:01.025677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.025951 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.026218 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] PATH_INFO: `/v3/users/6f6e646d0907431d915cbe141a9931f6` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.028193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6e646d0907431d915cbe141a9931f6)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:01.030426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:01.090919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6e646d0907431d915cbe141a9931f6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.100003 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6e646d0907431d915cbe141a9931f6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.112662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6e646d0907431d915cbe141a9931f6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.113290 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6e646d0907431d915cbe141a9931f6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.120996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6e646d0907431d915cbe141a9931f6'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.128257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1380/2768] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:00 2022] DELETE /identity/v3/users/6f6e646d0907431d915cbe141a9931f6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:01.132955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.133336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.133574 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.152512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:01.153715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:01.213536 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1389/2769] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:01.226054 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:01.228012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:01.256849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:01.292217 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e67238-6468-4981-933f-89760c2dbbf5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:01.299873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611efd9e-84b0-4a77-8629-d8307d5e2c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:01.304601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efd9e-84b0-4a77-8629-d8307d5e2c43 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.304601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efd9e-84b0-4a77-8629-d8307d5e2c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.304601 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611efd9e-84b0-4a77-8629-d8307d5e2c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.315566 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611efd9e-84b0-4a77-8629-d8307d5e2c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:01.317245 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611efd9e-84b0-4a77-8629-d8307d5e2c43 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:01.327386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1381/2770] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:01.605600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:01.607100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:01.619446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a06b28-33d1-451c-b680-95e7ae676d9e None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:01.624242 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:01.624878 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.625154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.625421 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] PATH_INFO: `/v3/projects/8045f8663ac84614956a9076cb261f24` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.626550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8045f8663ac84614956a9076cb261f24)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:01.628485 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:01.680386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8045f8663ac84614956a9076cb261f24', 'request_id': 'req-fd895646-ac10-43d9-856a-abb8994a431a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.689478 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8045f8663ac84614956a9076cb261f24', 'request_id': 'req-fd895646-ac10-43d9-856a-abb8994a431a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.695807 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8045f8663ac84614956a9076cb261f24', 'request_id': 'req-fd895646-ac10-43d9-856a-abb8994a431a'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.706008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] The token cache is being invalidate because project 8045f8663ac84614956a9076cb261f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:01.706300 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.706931 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-fd895646-ac10-43d9-856a-abb8994a431a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:01.708463 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1390/2771] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:01 2022] DELETE /identity/v3/projects/8045f8663ac84614956a9076cb261f24 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:01.714336 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345454-edc5-4b65-afdd-4643c47515a0 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.714618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345454-edc5-4b65-afdd-4643c47515a0 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.714918 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345454-edc5-4b65-afdd-4643c47515a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.734962 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c8345454-edc5-4b65-afdd-4643c47515a0 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:01.736211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c8345454-edc5-4b65-afdd-4643c47515a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:01.815183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1382/2772] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:01.823843 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf92ae-de8a-454f-976c-7d630490eee7 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.824128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf92ae-de8a-454f-976c-7d630490eee7 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.824411 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf92ae-de8a-454f-976c-7d630490eee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.846180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0daf92ae-de8a-454f-976c-7d630490eee7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:01.847409 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0daf92ae-de8a-454f-976c-7d630490eee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:01.856692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1391/2773] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:01.861537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345454-edc5-4b65-afdd-4643c47515a0 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:01.876185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345454-edc5-4b65-afdd-4643c47515a0 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:01.882527 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:01.883132 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.883658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.883994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.884565 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:40:01.884863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:01.886506 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:01.899163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1383/2774] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:40:01.903716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf92ae-de8a-454f-976c-7d630490eee7 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:01.909455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:01.914419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf92ae-de8a-454f-976c-7d630490eee7 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:01.922297 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:01.922961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:01.923330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:01.923685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:01.924539 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:01.926947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:01.957162 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1392/2775] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:01 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:01.961650 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:01.972230 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118118ae-3ffe-4996-9cbc-8cf611d66cff admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:02.037799 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:02.038609 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:02.038954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:02.039292 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:02.040049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:02.042005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:02.066175 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1384/2776] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:01 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:02.070550 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:02.084341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11222352-88d8-4c69-a605-e930549e33f4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:02.090077 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:02.090688 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:02.090960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:02.091231 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:02.091953 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:02.093522 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:02.104949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1393/2777] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:02.109033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:02.119658 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842a0e0-63f2-43d6-aa1c-7d3088f75dbc admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:02.124502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473710a-028a-4a8d-bb42-139b430efea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:02.125102 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473710a-028a-4a8d-bb42-139b430efea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:02.125373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473710a-028a-4a8d-bb42-139b430efea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:02.125645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473710a-028a-4a8d-bb42-139b430efea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:02.126262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473710a-028a-4a8d-bb42-139b430efea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:02.127875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473710a-028a-4a8d-bb42-139b430efea3 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:02.138767 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1385/2778] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:02.143243 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:02.153219 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e983a-1f25-4b9d-aa0c-aef88beab87e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:02.158695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:02.159384 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:02.159731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:02.160015 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] PATH_INFO: `/v3/projects/09f92ecd25d24efc9da2bf2716db6015/users/a4b2768e5322484dafe2d2304b4f1ae3/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:02.177202 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f92ecd25d24efc9da2bf2716db6015, user_id=a4b2768e5322484dafe2d2304b4f1ae3, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:02.180018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:02.194417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1394/2779] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:02 2022] PUT /identity/v3/projects/09f92ecd25d24efc9da2bf2716db6015/users/a4b2768e5322484dafe2d2304b4f1ae3/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:02.205384 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992f4b-1951-43fc-9da6-0be6d16fa98d None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:02.205674 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992f4b-1951-43fc-9da6-0be6d16fa98d None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:02.205921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992f4b-1951-43fc-9da6-0be6d16fa98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:02.234373 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-00992f4b-1951-43fc-9da6-0be6d16fa98d None None] MFA Rules not processed for user `a4b2768e5322484dafe2d2304b4f1ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:02.235623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-00992f4b-1951-43fc-9da6-0be6d16fa98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:02.255073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:02.312685 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1386/2780] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:02.324447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:02.326197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:02.396949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d061c-fe9f-4392-97ce-8599b67d58db admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:02.401446 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e97be-12e8-4082-b997-28ff38eacd23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:02.402064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e97be-12e8-4082-b997-28ff38eacd23 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:02.402345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e97be-12e8-4082-b997-28ff38eacd23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:02.402626 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e97be-12e8-4082-b997-28ff38eacd23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:02.414070 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e97be-12e8-4082-b997-28ff38eacd23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:02.415854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e97be-12e8-4082-b997-28ff38eacd23 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:02.430389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1395/2781] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:05.016299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992f4b-1951-43fc-9da6-0be6d16fa98d None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:05.087850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992f4b-1951-43fc-9da6-0be6d16fa98d None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:05.098305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:05.098999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.099279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.099567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] PATH_INFO: `/v3/users/a4b2768e5322484dafe2d2304b4f1ae3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.100809 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b2768e5322484dafe2d2304b4f1ae3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:05.102864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:05.160556 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b2768e5322484dafe2d2304b4f1ae3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.169742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b2768e5322484dafe2d2304b4f1ae3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.187856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b2768e5322484dafe2d2304b4f1ae3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.188591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b2768e5322484dafe2d2304b4f1ae3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.196253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b2768e5322484dafe2d2304b4f1ae3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.202226 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1387/2782] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:05 2022] DELETE /identity/v3/users/a4b2768e5322484dafe2d2304b4f1ae3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:05.206765 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.207278 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.207392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.227753 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:05.229310 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:05.303498 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1396/2783] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:05.310971 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:05.312885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:05.367116 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:05.384673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11978e3-306c-401e-a4db-a2d207aa02ce admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:05.388927 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0775983-d7d1-4685-92a5-e53225dd7600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:05.389550 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0775983-d7d1-4685-92a5-e53225dd7600 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.389827 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0775983-d7d1-4685-92a5-e53225dd7600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.390103 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0775983-d7d1-4685-92a5-e53225dd7600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.399451 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0775983-d7d1-4685-92a5-e53225dd7600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:05.400970 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0775983-d7d1-4685-92a5-e53225dd7600 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:05.411270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1388/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:05.684523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:05.686010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:05.699155 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ecfee-cf04-4037-8715-9c4687ea8447 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:05.704839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:05.705631 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.705947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.706217 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] PATH_INFO: `/v3/projects/09f92ecd25d24efc9da2bf2716db6015` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.707665 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f92ecd25d24efc9da2bf2716db6015)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:05.709925 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:05.758064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:05.761169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f92ecd25d24efc9da2bf2716db6015', 'request_id': 'req-bcb17999-7558-4cf9-bc87-4a3172df3b57'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.770924 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f92ecd25d24efc9da2bf2716db6015', 'request_id': 'req-bcb17999-7558-4cf9-bc87-4a3172df3b57'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.777565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f92ecd25d24efc9da2bf2716db6015', 'request_id': 'req-bcb17999-7558-4cf9-bc87-4a3172df3b57'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.788737 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] The token cache is being invalidate because project 09f92ecd25d24efc9da2bf2716db6015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:05.789044 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.789708 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-bcb17999-7558-4cf9-bc87-4a3172df3b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:05.791284 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1397/2785] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:05 2022] DELETE /identity/v3/projects/09f92ecd25d24efc9da2bf2716db6015 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:05.797127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6446d1-8925-4b90-906a-dc3f88625810 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.797470 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6446d1-8925-4b90-906a-dc3f88625810 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.797740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6446d1-8925-4b90-906a-dc3f88625810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.821376 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3a6446d1-8925-4b90-906a-dc3f88625810 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:05.822635 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3a6446d1-8925-4b90-906a-dc3f88625810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:05.889361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1389/2786] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:05.898587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874b9c-cf24-4055-ad98-1ddb3be04535 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.898879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874b9c-cf24-4055-ad98-1ddb3be04535 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.899158 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874b9c-cf24-4055-ad98-1ddb3be04535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.920009 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-0b874b9c-cf24-4055-ad98-1ddb3be04535 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:05.921569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-0b874b9c-cf24-4055-ad98-1ddb3be04535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:05.930939 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1398/2787] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:05.935683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6446d1-8925-4b90-906a-dc3f88625810 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:05.946253 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6446d1-8925-4b90-906a-dc3f88625810 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:05.951939 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:05.952545 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.952817 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.953082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.953727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:40:05.954024 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:05.955645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:05.967493 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1390/2788] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:40:05.972370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b874b9c-cf24-4055-ad98-1ddb3be04535 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:05.984754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b874b9c-cf24-4055-ad98-1ddb3be04535 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:05.990438 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:05.991034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:05.991307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:05.991586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:05.992252 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:05.994154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:06.023330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1399/2789] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:05 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:40:06.027718 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:06.037945 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479784a-9e08-42f7-9376-e3952adc97fa admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:06.109137 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:06.110047 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:06.110389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:06.110657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:06.111313 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:06.113434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:06.137894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1391/2790] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:06 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:06.142392 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:06.153285 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5e6d3-b5d6-4e91-a04e-514a86fce60e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:06.158190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:06.158788 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:06.159060 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:06.159333 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:06.160008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:06.161595 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:06.171938 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1400/2791] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:06.176233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:06.187081 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c36fd-aa3a-470f-ac83-f88c9e654b73 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:06.195719 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820b811-d221-4fbf-a662-a4cb04da234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:06.196425 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b811-d221-4fbf-a662-a4cb04da234a admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:06.196702 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b811-d221-4fbf-a662-a4cb04da234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:06.196972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820b811-d221-4fbf-a662-a4cb04da234a admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:06.197613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820b811-d221-4fbf-a662-a4cb04da234a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:06.199807 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820b811-d221-4fbf-a662-a4cb04da234a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:06.210746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1392/2792] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:06.215511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:06.229762 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b67eb-a740-49ac-bf11-36fa7e729f82 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:06.235239 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:06.235970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:06.236246 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:06.236517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] PATH_INFO: `/v3/projects/13bad4a657114a73800a535b2d33c108/users/0d67d57eb0e0457f949fdbe330a98e90/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:06.251908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bad4a657114a73800a535b2d33c108, user_id=0d67d57eb0e0457f949fdbe330a98e90, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:06.254580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:06.268855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1401/2793] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:06 2022] PUT /identity/v3/projects/13bad4a657114a73800a535b2d33c108/users/0d67d57eb0e0457f949fdbe330a98e90/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:06.279408 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:06.279782 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:06.280129 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:06.314574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] MFA Rules not processed for user `0d67d57eb0e0457f949fdbe330a98e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:06.315960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:06.356682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:06.386617 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1393/2794] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:06.399535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:06.401517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:06.460129 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023904b-b638-40f9-b930-4efe177e3bc6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:06.464084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bb9de-12c7-4370-b3b4-bed64fb84600 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d78fc219a25457ca11e38930b03e8ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:06.464705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb9de-12c7-4370-b3b4-bed64fb84600 service glance] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:06.465017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb9de-12c7-4370-b3b4-bed64fb84600 service glance] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:06.465289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bb9de-12c7-4370-b3b4-bed64fb84600 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:06.474008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bb9de-12c7-4370-b3b4-bed64fb84600 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:06.475447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bb9de-12c7-4370-b3b4-bed64fb84600 service glance] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:06.484551 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1402/2795] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:16.383656 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:16.480477 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:32.926683 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:32.928203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:32.995350 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb1a6-e879-4602-a7b1-b582490cdc9e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:33.000803 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:33.001435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.001707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.001978 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] PATH_INFO: `/v3/users/410e4e4fb932482ca6a549e59b342a95` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:33.003135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=410e4e4fb932482ca6a549e59b342a95)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:33.005152 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:33.056982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '410e4e4fb932482ca6a549e59b342a95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.066364 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '410e4e4fb932482ca6a549e59b342a95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.079176 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '410e4e4fb932482ca6a549e59b342a95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.079988 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '410e4e4fb932482ca6a549e59b342a95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.087499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '410e4e4fb932482ca6a549e59b342a95'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.093214 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1394/2796] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:32 2022] DELETE /identity/v3/users/410e4e4fb932482ca6a549e59b342a95 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:33.097871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.098469 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.098577 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:33.119143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:33.120394 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:33.178855 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1403/2797] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:33.188657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:33.190163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:33.253427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52996619-2133-4803-b894-de74a73fce18 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:33.258571 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:33.259187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.259500 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.259810 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:33.271135 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:33.272629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:33.282491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1395/2798] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:40:33.565842 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:33.567398 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:33.581735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa239e6-23c6-4d36-9e97-bb386607c609 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:33.587146 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:33.587907 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.588313 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.588600 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] PATH_INFO: `/v3/projects/0cb9ccb71e9748878095d836eec40fc8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:33.589791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb9ccb71e9748878095d836eec40fc8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:33.592055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:33.638612 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:33.640123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:33.643608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb9ccb71e9748878095d836eec40fc8', 'request_id': 'req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.653382 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68e9a3-2310-4cb0-af8b-124cbc9e7b75 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:33.654213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb9ccb71e9748878095d836eec40fc8', 'request_id': 'req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.660861 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb9ccb71e9748878095d836eec40fc8', 'request_id': 'req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.672220 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] The token cache is being invalidate because project 0cb9ccb71e9748878095d836eec40fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:33.672400 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:33.672521 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.673153 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.674791 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1404/2799] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:33 2022] DELETE /identity/v3/projects/0cb9ccb71e9748878095d836eec40fc8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:33.678871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:33.680567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:33.712406 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:33.713049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.713331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.713602 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] PATH_INFO: `/v3/users/0d67d57eb0e0457f949fdbe330a98e90` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:33.714742 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d67d57eb0e0457f949fdbe330a98e90)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:33.716713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:33.747768 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f38e-33f7-4fda-bb3c-41ee34145ded admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:33.752960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:33.753604 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.753885 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.754167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] PATH_INFO: `/v3/users/8f40465e65d243b58e02c07ca5a77ef8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:33.755367 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f40465e65d243b58e02c07ca5a77ef8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:33.757330 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:33.765778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d67d57eb0e0457f949fdbe330a98e90'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.775738 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d67d57eb0e0457f949fdbe330a98e90'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.786439 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:33.788979 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d67d57eb0e0457f949fdbe330a98e90'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.789843 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d67d57eb0e0457f949fdbe330a98e90'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.798191 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a2b3a766-b575-4095-ba25-9f7073805d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d67d57eb0e0457f949fdbe330a98e90'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.804389 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1396/2800] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:33 2022] DELETE /identity/v3/users/0d67d57eb0e0457f949fdbe330a98e90 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:40:33.808778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.809065 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.809224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f40465e65d243b58e02c07ca5a77ef8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.809346 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:33.818197 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f40465e65d243b58e02c07ca5a77ef8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.818959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f40465e65d243b58e02c07ca5a77ef8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.826173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f40465e65d243b58e02c07ca5a77ef8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.829233 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:33.830456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:33.838779 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f40465e65d243b58e02c07ca5a77ef8'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:33.844829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1405/2801] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:33 2022] DELETE /identity/v3/users/8f40465e65d243b58e02c07ca5a77ef8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:40:33.891507 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1397/2802] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:33.902137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:33.903628 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:33.964023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345fc2c-5a3d-4500-bb0f-b0013104cef0 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:33.967856 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552405-ea47-4b1e-a39d-0b0dab15d96b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:33.968533 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552405-ea47-4b1e-a39d-0b0dab15d96b service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.968813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552405-ea47-4b1e-a39d-0b0dab15d96b service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.969087 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552405-ea47-4b1e-a39d-0b0dab15d96b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.031298 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552405-ea47-4b1e-a39d-0b0dab15d96b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.032783 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552405-ea47-4b1e-a39d-0b0dab15d96b service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.043652 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1406/2803] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:40:34.171653 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.173371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.185620 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab6b1b-5b04-4797-b982-692b14812016 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.192005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.193401 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.193722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.193992 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] PATH_INFO: `/v3/projects/0deef76407424c0a99eb8a1a07c373db` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.195610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0deef76407424c0a99eb8a1a07c373db)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.198207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.247441 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:34.259919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0deef76407424c0a99eb8a1a07c373db', 'request_id': 'req-1eb26f80-1163-40ff-ad24-84c7d627df2c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.266508 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0deef76407424c0a99eb8a1a07c373db', 'request_id': 'req-1eb26f80-1163-40ff-ad24-84c7d627df2c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.272954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0deef76407424c0a99eb8a1a07c373db', 'request_id': 'req-1eb26f80-1163-40ff-ad24-84c7d627df2c'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.290591 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] The token cache is being invalidate because project 0deef76407424c0a99eb8a1a07c373db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:34.290892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.291581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.293082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1398/2804] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:34 2022] DELETE /identity/v3/projects/0deef76407424c0a99eb8a1a07c373db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:34.298561 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23011-697d-450a-a21c-a22473b2218f None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.299073 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23011-697d-450a-a21c-a22473b2218f None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.299180 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23011-697d-450a-a21c-a22473b2218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.319113 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2ae23011-697d-450a-a21c-a22473b2218f None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:34.320375 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2ae23011-697d-450a-a21c-a22473b2218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.373182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:34.379207 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.381009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.400535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1407/2805] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:34.408959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2032f8-e0b6-4373-accc-d34cb6753ef8 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.409280 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2032f8-e0b6-4373-accc-d34cb6753ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.409459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2032f8-e0b6-4373-accc-d34cb6753ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.431093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-de2032f8-e0b6-4373-accc-d34cb6753ef8 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:34.432356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-de2032f8-e0b6-4373-accc-d34cb6753ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.443572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1408/2806] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:34.444970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2032f8-e0b6-4373-accc-d34cb6753ef8 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.454108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2032f8-e0b6-4373-accc-d34cb6753ef8 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.454275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb26f80-1163-40ff-ad24-84c7d627df2c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.458831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.459015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.459425 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.459727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.459848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.460002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.460111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.460271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] PATH_INFO: `/v3/projects/13bad4a657114a73800a535b2d33c108` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.460650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81593) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:40:34.460954 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.461455 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=13bad4a657114a73800a535b2d33c108)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.462548 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.463416 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.474821 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1409/2807] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:40:34.479003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.490799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8203b-f4f5-42cb-bd59-40c10f96d3ea admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.496122 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.496876 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.497213 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.497567 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.498256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.500223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.513645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13bad4a657114a73800a535b2d33c108', 'request_id': 'req-f60fb0fa-4a8a-4218-aa7f-30136913dacc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.519361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13bad4a657114a73800a535b2d33c108', 'request_id': 'req-f60fb0fa-4a8a-4218-aa7f-30136913dacc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.526076 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13bad4a657114a73800a535b2d33c108', 'request_id': 'req-f60fb0fa-4a8a-4218-aa7f-30136913dacc'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.528930 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1410/2808] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:40:34.533275 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.543086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] The token cache is being invalidate because project 13bad4a657114a73800a535b2d33c108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:34.543378 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.544046 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-f60fb0fa-4a8a-4218-aa7f-30136913dacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:34.545559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1399/2809] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:34 2022] DELETE /identity/v3/projects/13bad4a657114a73800a535b2d33c108 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:40:34.550746 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5cef4-a95d-415c-85f0-4d7fa5a526bc None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.551141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5cef4-a95d-415c-85f0-4d7fa5a526bc None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.551518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5cef4-a95d-415c-85f0-4d7fa5a526bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.573634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f3a5cef4-a95d-415c-85f0-4d7fa5a526bc None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:34.575183 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f3a5cef4-a95d-415c-85f0-4d7fa5a526bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.596274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411dde7e-542b-4a91-80da-d7faee8ecf9a admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.602395 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.603008 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.603293 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.603590 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.604229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.606151 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.625255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:34.629617 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1411/2810] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:40:34.634131 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.635799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.643690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1400/2811] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:34.647211 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa9d2-3bf5-4afd-94ea-4c2ef65731e7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.647497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa9d2-3bf5-4afd-94ea-4c2ef65731e7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.647804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa9d2-3bf5-4afd-94ea-4c2ef65731e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.648119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4f58f-6ed8-4e2d-8abd-f77c43afba93 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.652692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.653290 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.653569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.653839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.654512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.656121 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.669947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1412/2812] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:40:34.670134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-0c9fa9d2-3bf5-4afd-94ea-4c2ef65731e7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:34.670134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-0c9fa9d2-3bf5-4afd-94ea-4c2ef65731e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.671108 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.680825 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1401/2813] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:34.682528 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803c07d-70e5-429f-9c41-5fa63bea9ca6 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.684879 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa9d2-3bf5-4afd-94ea-4c2ef65731e7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.687798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.688402 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.688680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.688960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.689597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.691172 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.694127 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fa9d2-3bf5-4afd-94ea-4c2ef65731e7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.698693 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.699295 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.699576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.699860 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.700497 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:40:34.700791 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.702351 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.702468 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1413/2814] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:34.706650 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.714002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1402/2815] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:40:34.716308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bac7dd-9e1d-4d70-8725-803c75b09790 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.718036 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.721387 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec67ca-3bf4-4160-880b-1d527af4bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.722030 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec67ca-3bf4-4160-880b-1d527af4bc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.722307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec67ca-3bf4-4160-880b-1d527af4bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.722684 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec67ca-3bf4-4160-880b-1d527af4bc80 admin admin] PATH_INFO: `/v3/projects/ee79251307984a2f8121079df1bf2871/users/90f78973db6a4fb9a328720f9e3865b8/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.727847 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19426e5-7ce5-4c09-a7c8-0a1a600cad70 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.733070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.733655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.733947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.734409 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.735177 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.737109 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.737632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec67ca-3bf4-4160-880b-1d527af4bc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee79251307984a2f8121079df1bf2871, user_id=90f78973db6a4fb9a328720f9e3865b8, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.740378 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec67ca-3bf4-4160-880b-1d527af4bc80 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.753874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1414/2816] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:34 2022] PUT /identity/v3/projects/ee79251307984a2f8121079df1bf2871/users/90f78973db6a4fb9a328720f9e3865b8/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:40:34.765163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5762-914a-4a63-9f3a-9190b19ba556 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.765495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5762-914a-4a63-9f3a-9190b19ba556 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.765716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c5762-914a-4a63-9f3a-9190b19ba556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.770263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1403/2817] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:40:34.771163 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.795419 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ab4c5762-914a-4a63-9f3a-9190b19ba556 None None] MFA Rules not processed for user `90f78973db6a4fb9a328720f9e3865b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:34.797128 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ab4c5762-914a-4a63-9f3a-9190b19ba556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.833781 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b943f-3f76-4ae2-88b8-a8c12fd9cc53 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.839029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.839694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.839972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.840239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.840875 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.841359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:34.842895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.865623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1415/2818] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:34.867215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1404/2819] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:34.870288 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5762-914a-4a63-9f3a-9190b19ba556 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.871033 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.880673 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877b1f1-567e-4954-860a-41bdfcac2189 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.880973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c5762-914a-4a63-9f3a-9190b19ba556 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.885215 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.885537 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.885792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.886066 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.886173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.886352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.886517 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.886794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.886963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.887429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.888579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.889353 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.898502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1405/2820] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:40:34.902348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.912581 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e61c05b-1e85-45ed-99c4-82bae915c85e admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.917691 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.918383 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.918692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.918995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.919872 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.920066 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1416/2821] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:34.921888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.924304 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.938477 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1406/2822] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:40:34.939491 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.949618 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced6919-807b-4ea6-b2e2-be61610b4635 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.988283 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b988f-3545-4ab3-95b3-954a8dda7c14 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.993195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.993803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.994074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.994341 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] PATH_INFO: `/v3/users` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.994967 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.996955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.005964 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.006633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.006954 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.007222 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] PATH_INFO: `/v3/projects/b808c91e23a14b369cb5212f51d68b13/users/29aa8029f21a49c9a66b1d50e5805070/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.021116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1417/2823] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:35.024603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b808c91e23a14b369cb5212f51d68b13, user_id=29aa8029f21a49c9a66b1d50e5805070, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.024911 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.027326 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.035097 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3c5c2-d335-4d5a-8d80-4ec303f4c135 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.040185 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce2be3-8b63-440e-a425-5316bfadc46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.040773 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce2be3-8b63-440e-a425-5316bfadc46d admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.041045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce2be3-8b63-440e-a425-5316bfadc46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.041311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce2be3-8b63-440e-a425-5316bfadc46d admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.041942 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce2be3-8b63-440e-a425-5316bfadc46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.043499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1407/2824] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:34 2022] PUT /identity/v3/projects/b808c91e23a14b369cb5212f51d68b13/users/29aa8029f21a49c9a66b1d50e5805070/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:35.043859 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce2be3-8b63-440e-a425-5316bfadc46d admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.054893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1418/2825] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:40:35.059466 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.065652 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:35.112584 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.113154 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.113576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.131896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75030e6-e74e-4f60-92cd-c607c380d884 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.137504 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.138192 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.138465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.138733 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] PATH_INFO: `/v3/projects/00d54b17a10449308d0ec4b9d2e13e64/users/8b54df8caf5048479241e38d45ff4d16/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.142107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] MFA Rules not processed for user `29aa8029f21a49c9a66b1d50e5805070`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:35.143360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.155012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d54b17a10449308d0ec4b9d2e13e64, user_id=8b54df8caf5048479241e38d45ff4d16, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.157698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.172955 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1408/2826] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:35 2022] PUT /identity/v3/projects/00d54b17a10449308d0ec4b9d2e13e64/users/8b54df8caf5048479241e38d45ff4d16/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:35.177058 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.214466 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1419/2827] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:35.227188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.228671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.239209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e988275-f00a-4f04-8549-4d53058163b6 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.243858 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.244465 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.244740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.245009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.245644 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.247304 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.257696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1409/2828] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:40:35.261836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.261987 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:35.271949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d5628-245a-4282-b34d-74bd8ac1169f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.276579 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549e548-801a-4e65-877c-ff17e381b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.277227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549e548-801a-4e65-877c-ff17e381b9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.277510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549e548-801a-4e65-877c-ff17e381b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.277785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549e548-801a-4e65-877c-ff17e381b9ea admin admin] PATH_INFO: `/v3/projects/00d54b17a10449308d0ec4b9d2e13e64/users/8b54df8caf5048479241e38d45ff4d16/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.279788 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549e548-801a-4e65-877c-ff17e381b9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d54b17a10449308d0ec4b9d2e13e64, user_id=8b54df8caf5048479241e38d45ff4d16, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.282430 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549e548-801a-4e65-877c-ff17e381b9ea admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.290895 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e47e7a-f886-480e-9072-4c1a78ee9455 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.294615 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1410/2829] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:35 2022] PUT /identity/v3/projects/00d54b17a10449308d0ec4b9d2e13e64/users/8b54df8caf5048479241e38d45ff4d16/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:40:35.306367 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dc600-8593-4beb-abfc-b825ba0f8589 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.306778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dc600-8593-4beb-abfc-b825ba0f8589 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.307062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dc600-8593-4beb-abfc-b825ba0f8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.343682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-2a2dc600-8593-4beb-abfc-b825ba0f8589 None None] MFA Rules not processed for user `8b54df8caf5048479241e38d45ff4d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:35.343964 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.344462 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.344576 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.344851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.344974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2a2dc600-8593-4beb-abfc-b825ba0f8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.404348 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.405820 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.408032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:35.415871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1420/2830] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:40:35.418227 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1411/2831] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:35.430090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.431573 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.442752 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4cd34-4b7d-448a-8965-5ca14e25cdbc service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.446558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b22b57-e42a-42de-a8f4-5a0ddd0de679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.447163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22b57-e42a-42de-a8f4-5a0ddd0de679 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.447496 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22b57-e42a-42de-a8f4-5a0ddd0de679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.447755 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22b57-e42a-42de-a8f4-5a0ddd0de679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.456892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b22b57-e42a-42de-a8f4-5a0ddd0de679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.458507 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b22b57-e42a-42de-a8f4-5a0ddd0de679 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.468116 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1421/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:35.607019 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2dc600-8593-4beb-abfc-b825ba0f8589 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.691418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2dc600-8593-4beb-abfc-b825ba0f8589 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.698944 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.699623 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.699902 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.700231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] PATH_INFO: `/v3/users/90f78973db6a4fb9a328720f9e3865b8` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.701368 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f78973db6a4fb9a328720f9e3865b8)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.703856 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.764089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f78973db6a4fb9a328720f9e3865b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:35.774244 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f78973db6a4fb9a328720f9e3865b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:35.786385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f78973db6a4fb9a328720f9e3865b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:35.787012 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f78973db6a4fb9a328720f9e3865b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:35.793837 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f78973db6a4fb9a328720f9e3865b8'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:35.800098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1412/2833] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:35 2022] DELETE /identity/v3/users/90f78973db6a4fb9a328720f9e3865b8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:40:35.804863 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.805270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.805633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.824760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:35.825955 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.887476 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1422/2834] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:35.898181 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.900894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.973663 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c043c0c-8a39-4418-be19-788db9bc3d24 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.980648 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.981626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.982087 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.982533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.996113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.997561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:36.008063 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1413/2835] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:36.290117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:36.291744 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:36.305212 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf18194-39f5-4df9-a1fe-ec2277f365a9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:36.310088 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:36.310731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:36.311032 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:36.311292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] PATH_INFO: `/v3/projects/ee79251307984a2f8121079df1bf2871` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:36.312455 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee79251307984a2f8121079df1bf2871)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:36.314360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:36.341018 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:36.368086 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee79251307984a2f8121079df1bf2871', 'request_id': 'req-5a1b1c14-13ec-4d7d-b65b-a412a532790b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.378119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee79251307984a2f8121079df1bf2871', 'request_id': 'req-5a1b1c14-13ec-4d7d-b65b-a412a532790b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.385091 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee79251307984a2f8121079df1bf2871', 'request_id': 'req-5a1b1c14-13ec-4d7d-b65b-a412a532790b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.396593 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] The token cache is being invalidate because project ee79251307984a2f8121079df1bf2871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:36.396871 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.397670 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.399318 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1423/2836] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:36 2022] DELETE /identity/v3/projects/ee79251307984a2f8121079df1bf2871 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:36.403509 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:36.413692 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18fc1a-630c-4fd2-9c21-512d9820b94f service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:36.426578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:36.474240 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:36.474896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:36.475154 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:36.475426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] PATH_INFO: `/v3/users/8b54df8caf5048479241e38d45ff4d16` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:36.476713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b54df8caf5048479241e38d45ff4d16)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:36.478638 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:36.527713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b54df8caf5048479241e38d45ff4d16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.536062 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b54df8caf5048479241e38d45ff4d16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.548100 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b54df8caf5048479241e38d45ff4d16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.548727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b54df8caf5048479241e38d45ff4d16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.555734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a13bc2de-1893-4d35-81d5-edcfd5778b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b54df8caf5048479241e38d45ff4d16'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.561461 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1414/2837] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:36 2022] DELETE /identity/v3/users/8b54df8caf5048479241e38d45ff4d16 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:36.848671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:36.850208 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:36.865331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b1c14-13ec-4d7d-b65b-a412a532790b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:36.928464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:36.929193 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:36.929470 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:36.929738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] PATH_INFO: `/v3/projects/00d54b17a10449308d0ec4b9d2e13e64` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:36.930849 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d54b17a10449308d0ec4b9d2e13e64)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:36.933084 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:36.994019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d54b17a10449308d0ec4b9d2e13e64', 'request_id': 'req-7aba32b6-e42c-4552-a9db-ead9f7225dfe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.003891 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d54b17a10449308d0ec4b9d2e13e64', 'request_id': 'req-7aba32b6-e42c-4552-a9db-ead9f7225dfe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.010692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d54b17a10449308d0ec4b9d2e13e64', 'request_id': 'req-7aba32b6-e42c-4552-a9db-ead9f7225dfe'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.022733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] The token cache is being invalidate because project 00d54b17a10449308d0ec4b9d2e13e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:37.023020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.023760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-7aba32b6-e42c-4552-a9db-ead9f7225dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.025308 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1424/2838] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:36 2022] DELETE /identity/v3/projects/00d54b17a10449308d0ec4b9d2e13e64 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:37.030459 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfbc7e-26b1-4604-b2dc-bb452ab20bf5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.030689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfbc7e-26b1-4604-b2dc-bb452ab20bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.030968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfbc7e-26b1-4604-b2dc-bb452ab20bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.050878 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-14cfbc7e-26b1-4604-b2dc-bb452ab20bf5 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:37.052309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-14cfbc7e-26b1-4604-b2dc-bb452ab20bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:37.112789 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1415/2839] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:37.125076 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8508f3-6e0e-4305-9157-99f815597e51 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.125373 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8508f3-6e0e-4305-9157-99f815597e51 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.125731 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8508f3-6e0e-4305-9157-99f815597e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.148407 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-ad8508f3-6e0e-4305-9157-99f815597e51 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:37.149629 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-ad8508f3-6e0e-4305-9157-99f815597e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:37.158829 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1425/2840] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:37.163561 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfbc7e-26b1-4604-b2dc-bb452ab20bf5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.173925 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfbc7e-26b1-4604-b2dc-bb452ab20bf5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.180089 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.180686 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.180960 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.181216 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.181888 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:40:37.182190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.183857 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.196029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1416/2841] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:40:37.200603 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8508f3-6e0e-4305-9157-99f815597e51 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.210064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8508f3-6e0e-4305-9157-99f815597e51 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.215266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.215897 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.216173 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.216449 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.217123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.219020 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.251702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1426/2842] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:37 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:37.258634 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.273341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e0b4c-3911-4a55-8c35-1e69a39e2768 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.294600 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:37.338919 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.339530 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.339845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.340120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.340758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.342694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.366871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1417/2843] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:37 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:37.371492 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.382685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60801b-37e8-4950-a3ca-37a842e504ea admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.387784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.388413 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.388715 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.388989 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.389635 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.391238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.403340 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1427/2844] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:37.407688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.419436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197a270-0dfe-4fd2-9b3e-d04136877b3c admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.434822 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc37416-64f3-4b06-aa77-eb2620620a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.435436 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37416-64f3-4b06-aa77-eb2620620a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.435768 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37416-64f3-4b06-aa77-eb2620620a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.436040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc37416-64f3-4b06-aa77-eb2620620a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.436682 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc37416-64f3-4b06-aa77-eb2620620a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.438299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc37416-64f3-4b06-aa77-eb2620620a18 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.450288 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1418/2845] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:37.455359 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.461810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:37.467423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59603c-5264-4536-b001-b12d4f96ca21 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.474644 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.475312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.475706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.475995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] PATH_INFO: `/v3/projects/03957bfacb624da29227f5ea670e416e/users/a84174156b7d46b883f616d2a6a86ddf/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.492317 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03957bfacb624da29227f5ea670e416e, user_id=a84174156b7d46b883f616d2a6a86ddf, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.495011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.510912 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1428/2846] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:37 2022] PUT /identity/v3/projects/03957bfacb624da29227f5ea670e416e/users/a84174156b7d46b883f616d2a6a86ddf/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:37.521795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9f36-1a70-4df5-aaba-c8aabb4d151f None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.522085 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9f36-1a70-4df5-aaba-c8aabb4d151f None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.522374 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9f36-1a70-4df5-aaba-c8aabb4d151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.551796 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-ffef9f36-1a70-4df5-aaba-c8aabb4d151f None None] MFA Rules not processed for user `a84174156b7d46b883f616d2a6a86ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:37.552989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ffef9f36-1a70-4df5-aaba-c8aabb4d151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:37.628189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1419/2847] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:37.633174 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.708337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d245da-2bf6-465f-84bd-64d3adb2522e admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.713514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.714137 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.714415 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.714683 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.715315 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.717259 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.753230 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1429/2848] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:37 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:37.758387 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef9f36-1a70-4df5-aaba-c8aabb4d151f None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.770473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef9f36-1a70-4df5-aaba-c8aabb4d151f None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.832668 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.833009 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.833305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.833524 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.834172 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.836167 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.859013 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1420/2849] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:37 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:37.863205 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.874023 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92b925-43b6-4dea-bd1d-d86705a49e5b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.879730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.880255 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.880531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.880798 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.881435 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.883028 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.893944 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1430/2850] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:40:37.898247 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.908671 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e99f4a-effe-4334-a7df-02feb02253ca admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.914189 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.914839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.915117 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.915394 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] PATH_INFO: `/v3/projects/7ad1420e41154fe8933c54862ef5cd7c/users/fd483bc31b014e5dadfe99473a03833d/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.932219 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad1420e41154fe8933c54862ef5cd7c, user_id=fd483bc31b014e5dadfe99473a03833d, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.934892 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.945342 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:37.951435 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1421/2851] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:37 2022] PUT /identity/v3/projects/7ad1420e41154fe8933c54862ef5cd7c/users/fd483bc31b014e5dadfe99473a03833d/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:37.955447 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.965758 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca4841-ebcb-4c28-aa43-73e199d0ee82 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:38.036799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa097092-3c7a-4d21-8c83-b39178fc2ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:38.037494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa097092-3c7a-4d21-8c83-b39178fc2ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:38.037810 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa097092-3c7a-4d21-8c83-b39178fc2ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:38.038080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa097092-3c7a-4d21-8c83-b39178fc2ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:38.038814 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa097092-3c7a-4d21-8c83-b39178fc2ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:38.040441 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa097092-3c7a-4d21-8c83-b39178fc2ec5 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:38.053914 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1431/2852] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:38.058291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:38.069386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fc9ca-fa6a-4956-b449-a291f70003de admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:38.074356 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:38.075015 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:38.075291 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:38.075567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] PATH_INFO: `/v3/projects/7ad1420e41154fe8933c54862ef5cd7c/users/fd483bc31b014e5dadfe99473a03833d/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:38.077883 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad1420e41154fe8933c54862ef5cd7c, user_id=fd483bc31b014e5dadfe99473a03833d, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:38.080846 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:38.092637 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1422/2853] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:38 2022] PUT /identity/v3/projects/7ad1420e41154fe8933c54862ef5cd7c/users/fd483bc31b014e5dadfe99473a03833d/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:38.104960 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828c2b-ee9c-4544-b6e5-795358e756a2 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:38.105336 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828c2b-ee9c-4544-b6e5-795358e756a2 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:38.105620 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b828c2b-ee9c-4544-b6e5-795358e756a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:38.138669 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-9b828c2b-ee9c-4544-b6e5-795358e756a2 None None] MFA Rules not processed for user `fd483bc31b014e5dadfe99473a03833d`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:38.140107 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9b828c2b-ee9c-4544-b6e5-795358e756a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:38.204661 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:38.237370 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1432/2854] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:38.249873 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:38.251721 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:38.315567 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297ac82-931f-48de-9eae-1fb6fba3aaa1 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:38.320038 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:38.320657 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:38.320934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:38.321203 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:38.330863 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:38.332348 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:38.341884 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1423/2855] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:38.421726 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828c2b-ee9c-4544-b6e5-795358e756a2 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:38.432677 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b828c2b-ee9c-4544-b6e5-795358e756a2 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:38.436495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9dbba-8110-4cae-827c-557d0cab6d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:38.437101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9dbba-8110-4cae-827c-557d0cab6d6e service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:38.437376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9dbba-8110-4cae-827c-557d0cab6d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:38.437645 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9dbba-8110-4cae-827c-557d0cab6d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:38.500874 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9dbba-8110-4cae-827c-557d0cab6d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:38.502295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9dbba-8110-4cae-827c-557d0cab6d6e service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:38.511489 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1433/2856] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:38.788661 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:38.860208 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afb0b-8856-4460-9fec-a288ee7daac3 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:38.866016 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:38.866633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:38.866911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:38.867179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] PATH_INFO: `/v3/users/a84174156b7d46b883f616d2a6a86ddf` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:38.868353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84174156b7d46b883f616d2a6a86ddf)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:38.870285 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:38.927778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84174156b7d46b883f616d2a6a86ddf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:38.936934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84174156b7d46b883f616d2a6a86ddf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:38.949727 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84174156b7d46b883f616d2a6a86ddf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:38.950361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84174156b7d46b883f616d2a6a86ddf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:38.957525 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84174156b7d46b883f616d2a6a86ddf'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:38.963990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1424/2857] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:38 2022] DELETE /identity/v3/users/a84174156b7d46b883f616d2a6a86ddf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:38.968727 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:38.969013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:38.969287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:38.989256 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:38.991062 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:39.052643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1434/2858] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:39.062649 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:39.064283 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:39.075371 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:39.126349 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9467c1-77ad-4664-8079-5771a9cff11f admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:39.130865 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:39.131472 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:39.131776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:39.132040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:39.142084 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:39.143577 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:39.153796 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1425/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:39.445982 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:39.447558 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:39.459733 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82402e89-7fab-4c04-ae4c-aa6bc2a0a585 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:39.464572 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:39.465221 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:39.465700 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:39.466196 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] PATH_INFO: `/v3/projects/03957bfacb624da29227f5ea670e416e` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:39.467303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03957bfacb624da29227f5ea670e416e)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:39.469269 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:39.520026 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03957bfacb624da29227f5ea670e416e', 'request_id': 'req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.528543 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03957bfacb624da29227f5ea670e416e', 'request_id': 'req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.535021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03957bfacb624da29227f5ea670e416e', 'request_id': 'req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.539884 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:39.548106 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] The token cache is being invalidate because project 03957bfacb624da29227f5ea670e416e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:39.548495 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.549456 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.551183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1435/2860] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:39 2022] DELETE /identity/v3/projects/03957bfacb624da29227f5ea670e416e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:39.555570 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:39.565677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf179c11-5e51-423f-8e76-70b9f45c4d47 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:39.623352 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:39.623982 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:39.624284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:39.624553 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] PATH_INFO: `/v3/users/fd483bc31b014e5dadfe99473a03833d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:39.625716 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd483bc31b014e5dadfe99473a03833d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:39.627677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:39.685642 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd483bc31b014e5dadfe99473a03833d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.695871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd483bc31b014e5dadfe99473a03833d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.714156 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd483bc31b014e5dadfe99473a03833d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.714907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd483bc31b014e5dadfe99473a03833d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.722687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2d8ae9f3-d44e-4f8b-9036-ce8eff50e4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd483bc31b014e5dadfe99473a03833d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:39.728842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1426/2861] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:39 2022] DELETE /identity/v3/users/fd483bc31b014e5dadfe99473a03833d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:40.052995 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.055123 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:40.070952 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06264-b12c-4a6d-8d19-fde6e4b63bcd admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.142118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.142480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.142668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.142803 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] PATH_INFO: `/v3/projects/7ad1420e41154fe8933c54862ef5cd7c` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.144059 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad1420e41154fe8933c54862ef5cd7c)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:40.146296 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:40.199934 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad1420e41154fe8933c54862ef5cd7c', 'request_id': 'req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:40.210295 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad1420e41154fe8933c54862ef5cd7c', 'request_id': 'req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:40.217170 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad1420e41154fe8933c54862ef5cd7c', 'request_id': 'req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:40.231695 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] The token cache is being invalidate because project 7ad1420e41154fe8933c54862ef5cd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:40.232019 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:40.232831 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-4a461a40-bb9c-4dd3-9e72-4c457eed2f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:40.234424 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1436/2862] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:40 2022] DELETE /identity/v3/projects/7ad1420e41154fe8933c54862ef5cd7c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:40.241476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac1ee-0287-43be-bacc-858b02e4129e None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.242041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac1ee-0287-43be-bacc-858b02e4129e None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.242159 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfac1ee-0287-43be-bacc-858b02e4129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.268744 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-cdfac1ee-0287-43be-bacc-858b02e4129e None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:40.270734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cdfac1ee-0287-43be-bacc-858b02e4129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:40.305256 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:40.352069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1427/2863] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:40:40.365634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bbde-1229-4757-8e2c-0a60a0725d6c None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.366465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bbde-1229-4757-8e2c-0a60a0725d6c None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.367526 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554bbde-1229-4757-8e2c-0a60a0725d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.401761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3554bbde-1229-4757-8e2c-0a60a0725d6c None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:40.402643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3554bbde-1229-4757-8e2c-0a60a0725d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:40.417314 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1437/2864] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:40.424575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfac1ee-0287-43be-bacc-858b02e4129e None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.437839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfac1ee-0287-43be-bacc-858b02e4129e None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.444866 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.445514 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.445769 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.446341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.446999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:40:40.447312 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:40.449816 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:40.469792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1428/2865] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:40:40.474643 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554bbde-1229-4757-8e2c-0a60a0725d6c None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.485117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554bbde-1229-4757-8e2c-0a60a0725d6c None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.491119 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.491808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.492064 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.492479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.493024 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:40.494963 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:40.535862 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1438/2866] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:40 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:40.540093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.552238 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cfd01-332a-48d2-b041-e94e554b349d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.626193 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.627690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.627690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.627690 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.628228 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:40.630309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:40.659014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1429/2867] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:40 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:40:40.664632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.678702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bab536-671e-48b4-93ff-69ed50ee0b45 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.682404 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.684159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.684159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.684159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.684672 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:40.686222 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:40.698636 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1439/2868] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:40.703776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.717512 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2b121-4943-4c6c-afc7-8b96b2ac9e15 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.723582 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827cc1-249a-47ac-992d-565c7aa0f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.724314 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827cc1-249a-47ac-992d-565c7aa0f304 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.724594 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827cc1-249a-47ac-992d-565c7aa0f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.724868 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827cc1-249a-47ac-992d-565c7aa0f304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.725518 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827cc1-249a-47ac-992d-565c7aa0f304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:40.727170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827cc1-249a-47ac-992d-565c7aa0f304 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:40.740532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1430/2869] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:40.747093 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.760350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52520a-c359-4214-ac00-68bb334e8f74 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.765992 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.766680 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.767511 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.767851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] PATH_INFO: `/v3/projects/ffd70846a1244697a341bb8a2248d3ca/users/deac0dc16f694f00b2aed50a43f89bf3/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.796751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd70846a1244697a341bb8a2248d3ca, user_id=deac0dc16f694f00b2aed50a43f89bf3, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:40.799702 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:40.820597 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1440/2870] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:40 2022] PUT /identity/v3/projects/ffd70846a1244697a341bb8a2248d3ca/users/deac0dc16f694f00b2aed50a43f89bf3/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:40.826108 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d326d-a700-41aa-8da7-5e5d8a99fad1 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.826377 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d326d-a700-41aa-8da7-5e5d8a99fad1 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.826707 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d326d-a700-41aa-8da7-5e5d8a99fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.848603 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-432d326d-a700-41aa-8da7-5e5d8a99fad1 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:40.850143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-432d326d-a700-41aa-8da7-5e5d8a99fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:40.910552 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1431/2871] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:40.920423 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:40.922529 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:40.950701 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:40.984429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54e6b-877d-4b5b-904e-69150ef4bb17 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:40.988686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:40.989307 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:40.989659 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:40.989921 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:40.999516 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:41.000997 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:41.010580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1441/2872] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:41.672011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da02afe-6eea-455b-bdbf-a3f81eadb6f5 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:41.672572 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da02afe-6eea-455b-bdbf-a3f81eadb6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:41.672698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da02afe-6eea-455b-bdbf-a3f81eadb6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:41.709792 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-8da02afe-6eea-455b-bdbf-a3f81eadb6f5 None None] MFA Rules not processed for user `deac0dc16f694f00b2aed50a43f89bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:41.711293 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8da02afe-6eea-455b-bdbf-a3f81eadb6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:41.736911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:41.778225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1432/2873] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:41.782764 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:41.793486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd908d-e8b2-4526-8c75-89eedfa5f091 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:41.798303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:41.798902 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:41.799175 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:41.799443 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:41.800143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:41.802132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:41.831276 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1442/2874] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:41 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:41.835709 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da02afe-6eea-455b-bdbf-a3f81eadb6f5 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:41.846625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da02afe-6eea-455b-bdbf-a3f81eadb6f5 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:41.904446 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:41.905059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:41.905339 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:41.905605 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:41.906243 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:41.908302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:41.934829 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1433/2875] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:41 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:41.940417 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:41.951520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76f453-3528-46ef-86cb-2256e72f1465 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:41.956748 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:41.957351 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:41.957624 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:41.957892 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:41.958706 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:41.960368 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:41.971331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1443/2876] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:41.975597 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:41.985910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344ed3c1-fdb8-47aa-8423-1dc8c6486558 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:41.991930 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:41.992580 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:41.992854 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:41.993126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] PATH_INFO: `/v3/projects/3d1e0ecb11da4484bb6e4f1b05cf21d8/users/16d86409da3e4598a0d36c2c00ed90ba/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:42.008270 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1e0ecb11da4484bb6e4f1b05cf21d8, user_id=16d86409da3e4598a0d36c2c00ed90ba, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:42.010921 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:42.026621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1434/2877] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:41 2022] PUT /identity/v3/projects/3d1e0ecb11da4484bb6e4f1b05cf21d8/users/16d86409da3e4598a0d36c2c00ed90ba/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:42.031017 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:42.041481 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b1430-a786-453e-8ede-64a573ded7be admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:42.100454 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b7862-6ec9-4f76-bd81-97e897ef7e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:42.101065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b7862-6ec9-4f76-bd81-97e897ef7e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:42.101345 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b7862-6ec9-4f76-bd81-97e897ef7e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:42.101614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b7862-6ec9-4f76-bd81-97e897ef7e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:42.102260 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b7862-6ec9-4f76-bd81-97e897ef7e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:42.103889 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b7862-6ec9-4f76-bd81-97e897ef7e2a admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:42.113549 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1444/2878] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:42.119187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:42.129610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046f676-0d7c-4236-9d62-e1ddb9b174de admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:42.134619 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166a221-e701-4850-b306-94870eedc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:42.135262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166a221-e701-4850-b306-94870eedc0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:42.135538 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166a221-e701-4850-b306-94870eedc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:42.135835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166a221-e701-4850-b306-94870eedc0bc admin admin] PATH_INFO: `/v3/projects/3d1e0ecb11da4484bb6e4f1b05cf21d8/users/16d86409da3e4598a0d36c2c00ed90ba/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:42.137771 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166a221-e701-4850-b306-94870eedc0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d1e0ecb11da4484bb6e4f1b05cf21d8, user_id=16d86409da3e4598a0d36c2c00ed90ba, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:42.140426 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166a221-e701-4850-b306-94870eedc0bc admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:42.151091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1435/2879] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:42 2022] PUT /identity/v3/projects/3d1e0ecb11da4484bb6e4f1b05cf21d8/users/16d86409da3e4598a0d36c2c00ed90ba/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:42.892401 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:42.893003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:42.893003 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:42.921027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] MFA Rules not processed for user `16d86409da3e4598a0d36c2c00ed90ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:42.922721 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:42.992879 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1445/2880] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:43.003448 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6ec7-8731-47f4-a36f-a45d062cbd02 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:43.004048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6ec7-8731-47f4-a36f-a45d062cbd02 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:43.004048 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f6ec7-8731-47f4-a36f-a45d062cbd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:43.024749 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-c59f6ec7-8731-47f4-a36f-a45d062cbd02 None None] MFA Rules not processed for user `deac0dc16f694f00b2aed50a43f89bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:43.025974 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-c59f6ec7-8731-47f4-a36f-a45d062cbd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:43.083626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1436/2881] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:43.096467 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:43.098149 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:43.113970 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:43.177929 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80c051-b0c1-4eb4-864c-87272e9bae5b None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:43.184182 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:43.184792 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:43.185067 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:43.185335 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:43.193379 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:43.194981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:43.203799 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1446/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:43.448836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f6ec7-8731-47f4-a36f-a45d062cbd02 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:43.476627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:43.522190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f6ec7-8731-47f4-a36f-a45d062cbd02 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:43.525990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:43.526633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:43.526910 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:43.527179 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:43.529037 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:43.538760 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:43.540232 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:43.548758 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1437/2883] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:43.910658 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:43.912329 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:43.995945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f03d7-9510-44ee-a4f6-fc0312999301 service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:44.001388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a26c23-cf69-4f6d-938a-ca3d02005c75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:44.002011 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26c23-cf69-4f6d-938a-ca3d02005c75 service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:44.002287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26c23-cf69-4f6d-938a-ca3d02005c75 service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:44.002559 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a26c23-cf69-4f6d-938a-ca3d02005c75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:44.004705 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-b6a26c23-cf69-4f6d-938a-ca3d02005c75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:44.016947 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a26c23-cf69-4f6d-938a-ca3d02005c75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:44.018512 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a26c23-cf69-4f6d-938a-ca3d02005c75 service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:44.031932 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1447/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:45.684631 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:45.686111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:45.756059 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21226722-1305-4d00-bdca-24970ebd5317 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:45.761396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:45.762092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:45.762372 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:45.762695 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] PATH_INFO: `/v3/users/29aa8029f21a49c9a66b1d50e5805070` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:45.763907 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=29aa8029f21a49c9a66b1d50e5805070)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:45.765852 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:45.818187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29aa8029f21a49c9a66b1d50e5805070'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:45.827170 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29aa8029f21a49c9a66b1d50e5805070'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:45.841643 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29aa8029f21a49c9a66b1d50e5805070'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:45.842307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29aa8029f21a49c9a66b1d50e5805070'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:45.849700 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29aa8029f21a49c9a66b1d50e5805070'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:45.856308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1438/2885] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:45 2022] DELETE /identity/v3/users/29aa8029f21a49c9a66b1d50e5805070 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:45.860795 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:45.861289 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:45.861406 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:45.880531 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:45.881760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:45.944786 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1448/2886] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:45.954844 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:45.956309 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:46.012092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:46.028299 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740aaba-f7f1-4a03-b94e-da64fa5485dd admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:46.032330 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:46.032956 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:46.033341 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:46.033621 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:46.044492 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:46.046039 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:46.056677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1439/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:40:46.072311 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:46.073777 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:46.087111 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b2e230-c06c-4a30-a253-7b23576de728 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:46.090880 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:46.091608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:46.092013 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:46.092437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:46.094480 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:46.105998 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:46.108190 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:46.117686 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1449/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:46.340736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:46.342385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:46.361322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2973-45f2-4bd7-bf16-97533ecd8633 service neutron] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:46.367014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:46.377578 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:46.377793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:46.378069 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] PATH_INFO: `/v3/projects/b808c91e23a14b369cb5212f51d68b13` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:46.379502 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b808c91e23a14b369cb5212f51d68b13)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:46.381726 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:46.436896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b808c91e23a14b369cb5212f51d68b13', 'request_id': 'req-a5b40501-078e-43b0-88c8-f9e7a23ded52'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:46.442452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b808c91e23a14b369cb5212f51d68b13', 'request_id': 'req-a5b40501-078e-43b0-88c8-f9e7a23ded52'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:46.448990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b808c91e23a14b369cb5212f51d68b13', 'request_id': 'req-a5b40501-078e-43b0-88c8-f9e7a23ded52'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:46.463011 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] The token cache is being invalidate because project b808c91e23a14b369cb5212f51d68b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:46.463305 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:46.464199 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:46.465722 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1440/2889] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:46 2022] DELETE /identity/v3/projects/b808c91e23a14b369cb5212f51d68b13 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:40:46.903570 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:46.905244 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:46.926717 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=100 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:46.984770 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946fab0-b496-47d7-b575-ff56fbec736f service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:47.047667 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:47.048286 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:47.048569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:47.048823 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:47.050693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:47.064608 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:47.066188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:47.078072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1450/2890] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:53.028999 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:53.030595 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:53.048611 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b40501-078e-43b0-88c8-f9e7a23ded52 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:53.054391 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '291c79a765764420a4b836c478c385b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:53.055002 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:53.055278 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:53.055559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:53.057481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:53.070841 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:53.072627 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:53.084662 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1441/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:57.073520 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=55 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:58.003035 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:58.004761 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:58.064038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5c0c1-12a2-46cd-b19e-a5f18bdf6a0e service nova] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:58.068586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:58.069188 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:58.069461 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:58.069737 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:58.071847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:58.146178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:58.147581 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:58.159051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1451/2892] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:41:03.079471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:08.154135 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=50 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:18.307220 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:18.308901 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:18.380646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd5a8-0d32-424a-ae11-791931190c47 service nova] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:18.385959 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:18.386574 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:18.386870 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:18.387138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] PATH_INFO: `/v3/users/deac0dc16f694f00b2aed50a43f89bf3` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:18.388343 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=deac0dc16f694f00b2aed50a43f89bf3)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:18.390533 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:18.440808 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deac0dc16f694f00b2aed50a43f89bf3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.451456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deac0dc16f694f00b2aed50a43f89bf3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.472823 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deac0dc16f694f00b2aed50a43f89bf3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.473880 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deac0dc16f694f00b2aed50a43f89bf3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.486187 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deac0dc16f694f00b2aed50a43f89bf3'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.493640 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1442/2893] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:41:18 2022] DELETE /identity/v3/users/deac0dc16f694f00b2aed50a43f89bf3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:18.678103 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:18.689118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb523212-dbb8-4061-9c12-31fce158707a service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:18.745827 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:18.746386 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:18.746663 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:18.746933 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] PATH_INFO: `/v3/projects/ffd70846a1244697a341bb8a2248d3ca` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:18.748102 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd70846a1244697a341bb8a2248d3ca)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:18.750010 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:18.800552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd70846a1244697a341bb8a2248d3ca', 'request_id': 'req-23159471-1976-461d-a249-b89a62bbc68b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.809728 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd70846a1244697a341bb8a2248d3ca', 'request_id': 'req-23159471-1976-461d-a249-b89a62bbc68b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.816036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd70846a1244697a341bb8a2248d3ca', 'request_id': 'req-23159471-1976-461d-a249-b89a62bbc68b'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.827494 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] The token cache is being invalidate because project ffd70846a1244697a341bb8a2248d3ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:41:18.827822 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.828535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.830183 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1452/2894] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:41:18 2022] DELETE /identity/v3/projects/ffd70846a1244697a341bb8a2248d3ca => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:18.834895 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:18.836585 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:18.850329 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d4270-6b4c-4794-b8fc-1dd0ccbdb41b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:18.911041 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:18.911689 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:18.911966 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:18.912307 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] PATH_INFO: `/v3/users/16d86409da3e4598a0d36c2c00ed90ba` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:18.913485 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d86409da3e4598a0d36c2c00ed90ba)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:18.915429 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:18.937458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:18.970155 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d86409da3e4598a0d36c2c00ed90ba'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.980655 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d86409da3e4598a0d36c2c00ed90ba'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.996453 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d86409da3e4598a0d36c2c00ed90ba'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:18.997126 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d86409da3e4598a0d36c2c00ed90ba'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:19.004280 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-c5c04b63-f32d-4c92-be11-0204865f24f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d86409da3e4598a0d36c2c00ed90ba'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:19.010481 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1443/2895] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:41:18 2022] DELETE /identity/v3/users/16d86409da3e4598a0d36c2c00ed90ba => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:19.190445 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.192118 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:19.206868 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23159471-1976-461d-a249-b89a62bbc68b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:19.267716 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:19.268229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.268510 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.268785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] PATH_INFO: `/v3/projects/3d1e0ecb11da4484bb6e4f1b05cf21d8` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.270036 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d1e0ecb11da4484bb6e4f1b05cf21d8)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:19.272267 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:19.311287 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:19.324869 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d1e0ecb11da4484bb6e4f1b05cf21d8', 'request_id': 'req-8ed765b8-2c24-43be-9011-ecf21e9ab502'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:19.333592 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d1e0ecb11da4484bb6e4f1b05cf21d8', 'request_id': 'req-8ed765b8-2c24-43be-9011-ecf21e9ab502'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:19.340045 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d1e0ecb11da4484bb6e4f1b05cf21d8', 'request_id': 'req-8ed765b8-2c24-43be-9011-ecf21e9ab502'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:19.350723 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] The token cache is being invalidate because project 3d1e0ecb11da4484bb6e4f1b05cf21d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:41:19.351001 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:19.351751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-8ed765b8-2c24-43be-9011-ecf21e9ab502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:19.353299 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1453/2896] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:41:19 2022] DELETE /identity/v3/projects/3d1e0ecb11da4484bb6e4f1b05cf21d8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:19.358362 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc80a6-609e-4756-bef7-b940b044b3a7 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.358896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc80a6-609e-4756-bef7-b940b044b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.358896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc80a6-609e-4756-bef7-b940b044b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.380968 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-f7dc80a6-609e-4756-bef7-b940b044b3a7 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:19.382143 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-f7dc80a6-609e-4756-bef7-b940b044b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:19.453302 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1444/2897] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:19.463365 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c82ed-d1b9-482e-8471-aaa7e969e1f9 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.463682 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c82ed-d1b9-482e-8471-aaa7e969e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.463958 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c82ed-d1b9-482e-8471-aaa7e969e1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.486134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-8f7c82ed-d1b9-482e-8471-aaa7e969e1f9 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:19.487354 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-8f7c82ed-d1b9-482e-8471-aaa7e969e1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:19.497100 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1454/2898] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:19.501573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc80a6-609e-4756-bef7-b940b044b3a7 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.514056 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc80a6-609e-4756-bef7-b940b044b3a7 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:19.520098 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:19.520629 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.520904 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.521169 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.522007 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:41:19.522236 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:19.523905 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:19.536070 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1445/2899] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:41:19.540535 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c82ed-d1b9-482e-8471-aaa7e969e1f9 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.550331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c82ed-d1b9-482e-8471-aaa7e969e1f9 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:19.555465 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:19.556089 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.556397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.556668 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.557303 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:19.559238 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:19.590281 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1455/2900] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:41:19 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:41:19.594396 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.604949 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6f3be-1908-4740-a72c-7d2b51e1b642 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:19.666935 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:19.667573 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.667842 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.668138 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.668777 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:19.670694 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:19.699896 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1446/2901] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:41:19 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:41:19.701253 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.712258 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45d497-6a7f-4110-8537-40567f7c5d73 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:19.717159 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:19.717760 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.718034 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.718305 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.718959 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:19.720569 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:19.730647 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1456/2902] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:19.734713 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.745049 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed8acd-3ba5-43d6-b6aa-a163cbbe6b33 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:19.750005 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc59ba-4ca0-4921-8902-0d8631407007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:19.750588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc59ba-4ca0-4921-8902-0d8631407007 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.750864 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc59ba-4ca0-4921-8902-0d8631407007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.751134 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc59ba-4ca0-4921-8902-0d8631407007 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.751840 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc59ba-4ca0-4921-8902-0d8631407007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:19.753434 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc59ba-4ca0-4921-8902-0d8631407007 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:19.764186 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1447/2903] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:19.768410 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.778848 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da1b4b-117b-4a18-8e21-66c9c9d2a914 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:19.783908 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:19.784554 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.784854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.785124 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] PATH_INFO: `/v3/projects/93232818684d487094a0a63ec0e66e3f/users/17471aaf4c724f0293fb1ec3f04e1d0d/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.801493 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93232818684d487094a0a63ec0e66e3f, user_id=17471aaf4c724f0293fb1ec3f04e1d0d, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:19.804475 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:19.819778 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1457/2904] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:41:19 2022] PUT /identity/v3/projects/93232818684d487094a0a63ec0e66e3f/users/17471aaf4c724f0293fb1ec3f04e1d0d/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:19.829885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba3975-393a-4913-8144-68eedc93a0c2 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:19.830168 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba3975-393a-4913-8144-68eedc93a0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:19.830439 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba3975-393a-4913-8144-68eedc93a0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:19.838625 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:19.859735 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-20ba3975-393a-4913-8144-68eedc93a0c2 None None] MFA Rules not processed for user `17471aaf4c724f0293fb1ec3f04e1d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:19.860972 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-20ba3975-393a-4913-8144-68eedc93a0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:19.928141 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1448/2905] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:19.939903 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:19.941858 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:20.001139 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5150d8-a3b2-42f4-b1b4-ba597920d653 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:20.005198 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1a1fd-84da-4e01-9e37-5a4564420c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:20.005794 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1a1fd-84da-4e01-9e37-5a4564420c25 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.006072 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1a1fd-84da-4e01-9e37-5a4564420c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.006342 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1a1fd-84da-4e01-9e37-5a4564420c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.015160 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1a1fd-84da-4e01-9e37-5a4564420c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:20.016623 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c1a1fd-84da-4e01-9e37-5a4564420c25 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:20.026233 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1458/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:41:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:41:20.055235 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba3975-393a-4913-8144-68eedc93a0c2 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:20.124969 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba3975-393a-4913-8144-68eedc93a0c2 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:20.130029 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:20.130994 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.131483 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.131794 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] PATH_INFO: `/v3/users/17471aaf4c724f0293fb1ec3f04e1d0d` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.133113 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17471aaf4c724f0293fb1ec3f04e1d0d)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:20.135073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:20.187231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17471aaf4c724f0293fb1ec3f04e1d0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.197613 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17471aaf4c724f0293fb1ec3f04e1d0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.211845 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17471aaf4c724f0293fb1ec3f04e1d0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.212510 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17471aaf4c724f0293fb1ec3f04e1d0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.219045 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17471aaf4c724f0293fb1ec3f04e1d0d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.224784 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1449/2907] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:41:20 2022] DELETE /identity/v3/users/17471aaf4c724f0293fb1ec3f04e1d0d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:20.229504 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.229785 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.230078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.250514 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:20.251809 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:20.307875 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:20.317981 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1459/2908] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:20.328324 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:20.329996 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:20.347262 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:20.408150 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d21841-99a6-4ba8-ae1f-ca8e065f2cf5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:20.414354 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c4af-ef82-4a05-b612-093abb9a4f33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:20.414963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c4af-ef82-4a05-b612-093abb9a4f33 service neutron] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.415264 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c4af-ef82-4a05-b612-093abb9a4f33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.415516 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c4af-ef82-4a05-b612-093abb9a4f33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.425898 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c4af-ef82-4a05-b612-093abb9a4f33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:20.427331 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c4af-ef82-4a05-b612-093abb9a4f33 service neutron] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:20.437559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1450/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:41:20.724164 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:20.725598 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:20.737730 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040986b-68a7-41a5-8b8f-3ebf347a5649 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:20.742363 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:20.743025 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.743383 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.743685 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] PATH_INFO: `/v3/projects/93232818684d487094a0a63ec0e66e3f` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.744808 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93232818684d487094a0a63ec0e66e3f)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:20.746738 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:20.795224 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93232818684d487094a0a63ec0e66e3f', 'request_id': 'req-c5b5fc59-7a3b-428d-bce7-9c10268d8748'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.803883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93232818684d487094a0a63ec0e66e3f', 'request_id': 'req-c5b5fc59-7a3b-428d-bce7-9c10268d8748'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.810591 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93232818684d487094a0a63ec0e66e3f', 'request_id': 'req-c5b5fc59-7a3b-428d-bce7-9c10268d8748'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.821751 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] The token cache is being invalidate because project 93232818684d487094a0a63ec0e66e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81593) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:41:20.822038 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.822666 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-c5b5fc59-7a3b-428d-bce7-9c10268d8748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:20.824237 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1460/2910] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:41:20 2022] DELETE /identity/v3/projects/93232818684d487094a0a63ec0e66e3f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:20.829263 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d042-abb0-45b0-9ebc-b71a6cb95371 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.829548 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d042-abb0-45b0-9ebc-b71a6cb95371 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.829812 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888d042-abb0-45b0-9ebc-b71a6cb95371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.850271 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-6888d042-abb0-45b0-9ebc-b71a6cb95371 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:20.851476 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-6888d042-abb0-45b0-9ebc-b71a6cb95371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:20.913885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1451/2911] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:20.923836 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6fc17-b593-451b-88ad-41ef5b35e8dc None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.924117 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6fc17-b593-451b-88ad-41ef5b35e8dc None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.924397 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6fc17-b593-451b-88ad-41ef5b35e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.946132 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-16d6fc17-b593-451b-88ad-41ef5b35e8dc None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:20.947358 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-16d6fc17-b593-451b-88ad-41ef5b35e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:20.955850 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1461/2912] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:20.960748 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888d042-abb0-45b0-9ebc-b71a6cb95371 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:20.971265 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888d042-abb0-45b0-9ebc-b71a6cb95371 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:20.976836 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:20.977415 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:20.977704 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:20.977963 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:20.978610 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81592) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:41:20.978905 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:20.980537 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:20.992965 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1452/2913] 10.222.0.18 () {58 vars in 1153 bytes} [Mon Sep 26 05:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:41:20.997586 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6fc17-b593-451b-88ad-41ef5b35e8dc None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.010452 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6fc17-b593-451b-88ad-41ef5b35e8dc None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.015735 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.016338 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.016614 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.016904 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.017552 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.019448 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.051565 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1462/2914] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:41:20 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:41:21.056432 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.070776 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7a120-b0ea-4ce2-b0dc-716cf62412f7 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.131696 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.132306 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.132588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.133072 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.133740 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.135708 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.162687 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1453/2915] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:41:21 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:41:21.167125 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.178127 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85c461-e753-4e15-b9ba-5e4c387b6276 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.183437 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.184082 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.184356 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.184618 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.185274 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.186834 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.197355 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1463/2916] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:21.201531 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.212083 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be84b1-36e7-4c1c-a03a-d6776c4cfc79 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.217359 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae9a40-0fc2-4105-984e-4e62f068d8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.217952 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9a40-0fc2-4105-984e-4e62f068d8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.218209 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9a40-0fc2-4105-984e-4e62f068d8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.218486 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae9a40-0fc2-4105-984e-4e62f068d8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.219118 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9a40-0fc2-4105-984e-4e62f068d8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.220745 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae9a40-0fc2-4105-984e-4e62f068d8a4 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.231645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1454/2917] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:21.235815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.246005 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d788b6-1c25-4ca2-b15b-d6704d6dc7e8 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.250839 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.251479 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.251782 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.252061 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] PATH_INFO: `/v3/projects/bd005aa4e26f493bb5a45244b506054a/users/19fa0cfeec0341f6831208e7ac41f843/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.266991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd005aa4e26f493bb5a45244b506054a, user_id=19fa0cfeec0341f6831208e7ac41f843, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.269671 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.285039 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1464/2918] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:41:21 2022] PUT /identity/v3/projects/bd005aa4e26f493bb5a45244b506054a/users/19fa0cfeec0341f6831208e7ac41f843/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:41:21.296385 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5767773-d8f9-4552-ba0f-bf37cacc9fc8 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.296670 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5767773-d8f9-4552-ba0f-bf37cacc9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.296942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5767773-d8f9-4552-ba0f-bf37cacc9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.333849 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-a5767773-d8f9-4552-ba0f-bf37cacc9fc8 None None] MFA Rules not processed for user `19fa0cfeec0341f6831208e7ac41f843`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:21.334947 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-a5767773-d8f9-4552-ba0f-bf37cacc9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:21.344678 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:21.402734 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1455/2919] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:21.407580 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.472703 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdd9ca-9ade-4d44-953b-9a68d3dfe7fc admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.477979 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.478579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.478854 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.479134 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.479813 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.481722 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.510679 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1465/2920] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:41:21 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:41:21.514934 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5767773-d8f9-4552-ba0f-bf37cacc9fc8 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.526275 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5767773-d8f9-4552-ba0f-bf37cacc9fc8 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.590206 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.590736 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.591014 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.591284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.591942 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.593871 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.615698 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1456/2921] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:41:21 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:41:21.619913 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.626824 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:21.631021 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd414d-64ad-4845-86e2-b17fd6c92c2b admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.636962 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.637883 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.638312 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.638697 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.639429 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.641826 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.652894 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1466/2922] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:21.657086 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.667532 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f590a6-b1a2-4f9c-8ce3-bdfcc1d88e14 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.673239 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721a047-dbbb-48a0-8ea2-13e745429f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.673839 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721a047-dbbb-48a0-8ea2-13e745429f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.674120 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721a047-dbbb-48a0-8ea2-13e745429f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.674392 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721a047-dbbb-48a0-8ea2-13e745429f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.675032 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721a047-dbbb-48a0-8ea2-13e745429f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.676677 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721a047-dbbb-48a0-8ea2-13e745429f1e admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.687353 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1457/2923] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:21.691634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.702046 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c781-431b-4ac8-a80f-040c7d941544 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.707101 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.707784 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.708058 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.708324 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] PATH_INFO: `/v3/projects/f23c50f4caa84129907ec8b4cf47e39e/users/92f6099dccf0480bbcbac85c8484134d/roles/834907900e824380a50e9ef4e00765c7` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.725055 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23c50f4caa84129907ec8b4cf47e39e, user_id=92f6099dccf0480bbcbac85c8484134d, role_id=834907900e824380a50e9ef4e00765c7)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.727833 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.746433 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1467/2924] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:41:21 2022] PUT /identity/v3/projects/f23c50f4caa84129907ec8b4cf47e39e/users/92f6099dccf0480bbcbac85c8484134d/roles/834907900e824380a50e9ef4e00765c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:21.762105 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b658796-c33a-40c8-9c1a-81bda5bd0646 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.762411 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b658796-c33a-40c8-9c1a-81bda5bd0646 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.762688 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b658796-c33a-40c8-9c1a-81bda5bd0646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.793985 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-3b658796-c33a-40c8-9c1a-81bda5bd0646 None None] MFA Rules not processed for user `92f6099dccf0480bbcbac85c8484134d`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:21.795225 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-3b658796-c33a-40c8-9c1a-81bda5bd0646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:21.866626 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1458/2925] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:21.871633 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.946263 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988e389-17a9-49a3-9f28-4844f1a75913 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:21.951195 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:21.951832 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:21.952109 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:21.952376 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:21.953007 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:21.954923 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:21.984622 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1468/2926] 10.222.0.18 () {60 vars in 1153 bytes} [Mon Sep 26 05:41:21 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:41:21.988753 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b658796-c33a-40c8-9c1a-81bda5bd0646 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:21.999575 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b658796-c33a-40c8-9c1a-81bda5bd0646 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:22.016427 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:22.059255 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:22.059885 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:22.060157 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:22.060431 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] PATH_INFO: `/v3/users` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:22.061073 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:22.062995 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:22.088082 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1459/2927] 10.222.0.18 () {60 vars in 1144 bytes} [Mon Sep 26 05:41:21 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:41:22.092270 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:22.102639 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c751c9-ae68-4871-bf25-6858cd1729f3 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:22.107506 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:22.108143 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:22.108420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:22.108687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:22.109357 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:22.110945 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:22.121689 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1469/2928] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:22.126055 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:22.136804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac19e7-582b-4761-9afd-fd2c2bab574a admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:22.142458 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:22.143111 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:22.143388 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:22.143705 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] PATH_INFO: `/v3/projects/8fccda73623242dbb26f171b392ed08f/users/409bdde7dda04c38b5e04542b2f6b5d4/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:22.160340 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fccda73623242dbb26f171b392ed08f, user_id=409bdde7dda04c38b5e04542b2f6b5d4, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:22.163035 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:22.178989 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1460/2929] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:41:22 2022] PUT /identity/v3/projects/8fccda73623242dbb26f171b392ed08f/users/409bdde7dda04c38b5e04542b2f6b5d4/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:41:22.183830 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:22.199350 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c23358-c038-435a-a4de-2b128fa825b1 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:22.262634 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1f28b-a18d-49cf-b8fe-15facf5e5892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:22.263240 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1f28b-a18d-49cf-b8fe-15facf5e5892 admin admin] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:22.263523 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1f28b-a18d-49cf-b8fe-15facf5e5892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:22.263825 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1f28b-a18d-49cf-b8fe-15facf5e5892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:22.264459 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1f28b-a18d-49cf-b8fe-15facf5e5892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:22.266057 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1f28b-a18d-49cf-b8fe-15facf5e5892 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:22.276027 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1470/2930] 10.222.0.18 () {58 vars in 1122 bytes} [Mon Sep 26 05:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:41:22.281720 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:22.292457 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb18389-66ad-4110-95e5-3c42bfc24f9b admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:22.297576 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:22.298251 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:22.298528 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:22.298804 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] PATH_INFO: `/v3/projects/8fccda73623242dbb26f171b392ed08f/users/409bdde7dda04c38b5e04542b2f6b5d4/roles/2a7a9fd3de9a46c0a085d538e1a486bb` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:22.300763 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fccda73623242dbb26f171b392ed08f, user_id=409bdde7dda04c38b5e04542b2f6b5d4, role_id=2a7a9fd3de9a46c0a085d538e1a486bb)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:22.303395 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:22.313932 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1461/2931] 10.222.0.18 () {60 vars in 1483 bytes} [Mon Sep 26 05:41:22 2022] PUT /identity/v3/projects/8fccda73623242dbb26f171b392ed08f/users/409bdde7dda04c38b5e04542b2f6b5d4/roles/2a7a9fd3de9a46c0a085d538e1a486bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:22.326332 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] REQUEST_METHOD: `POST` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:22.326640 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:22.326910 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:22.364227 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.auth.core [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] MFA Rules not processed for user `409bdde7dda04c38b5e04542b2f6b5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81593) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:22.365453 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:22.399029 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:22.441388 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1471/2932] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:22.453778 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:22.455931 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:22.519473 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a6994-456f-41b9-9f50-1ca46525e5d5 admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:22.523586 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:22.524190 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:22.524471 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:22.524835 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:22.591741 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:22.593911 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:22.606308 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1462/2933] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:41:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:41:24.149692 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:24.151337 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:24.164594 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5f337-21d7-45bc-8f1d-e8a573945521 None None] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:24.169369 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:24.170080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:24.170360 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:24.170630 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:24.232136 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:24.233497 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:24.242719 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1472/2934] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:41:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:41:24.831785 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:24.840681 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203048d-a810-4863-be67-ce1f7237a9e5 service cinder] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:24.844633 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad4361-46ba-4052-8ce9-de9edbd5af4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '262c0977be384e59a37ef91978012ad6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:24.845231 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4361-46ba-4052-8ce9-de9edbd5af4e service cinder] REQUEST_METHOD: `GET` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:24.845559 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4361-46ba-4052-8ce9-de9edbd5af4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:24.846185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad4361-46ba-4052-8ce9-de9edbd5af4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:24.856030 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4361-46ba-4052-8ce9-de9edbd5af4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:24.857452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad4361-46ba-4052-8ce9-de9edbd5af4e service cinder] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:24.866632 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1463/2935] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:41:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:41:28.820811 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:28.883828 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bd17b-55a1-496a-9f95-8f9f567b0d12 service cinder] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:28.889579 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:28.890225 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:28.890486 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:28.890754 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] PATH_INFO: `/v3/users/19fa0cfeec0341f6831208e7ac41f843` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:28.892090 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fa0cfeec0341f6831208e7ac41f843)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:28.894065 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:28.945331 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fa0cfeec0341f6831208e7ac41f843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:28.954589 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fa0cfeec0341f6831208e7ac41f843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:28.955266 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fa0cfeec0341f6831208e7ac41f843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:28.962464 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fa0cfeec0341f6831208e7ac41f843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:28.964430 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:28.976078 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fa0cfeec0341f6831208e7ac41f843'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:28.982602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1473/2936] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:41:28 2022] DELETE /identity/v3/users/19fa0cfeec0341f6831208e7ac41f843 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:28.987322 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] REQUEST_METHOD: `POST` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:28.987832 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:28.987980 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:29.008990 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.auth.core [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] MFA Rules not processed for user `7c1388531c2849fcb94bee4071a75c53`. Rule list: `[]` (Enabled: `True`). {{(pid=81592) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:41:29.010499 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:29.019131 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:29.074795 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1464/2937] 10.222.0.18 () {58 vars in 958 bytes} [Mon Sep 26 05:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:41:29.084818 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:29.086422 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:29.147693 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b24ca-bfd7-4143-9a81-28dcbdba6a36 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:29.152080 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de2913a65aac4fda97bc92dbf15d3316', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:29.152687 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:29.152961 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:29.153229 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:29.162928 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:29.164396 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:29.175169 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1474/2938] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:41:29.465092 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:29.466645 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:29.481010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ab08-257f-431a-8793-5aece34e95d4 None None] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:29.486197 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:29.486850 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:29.487123 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:29.487397 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] PATH_INFO: `/v3/projects/bd005aa4e26f493bb5a45244b506054a` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:29.488608 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd005aa4e26f493bb5a45244b506054a)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:29.490699 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:29.540599 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd005aa4e26f493bb5a45244b506054a', 'request_id': 'req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.547914 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd005aa4e26f493bb5a45244b506054a', 'request_id': 'req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.554386 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd005aa4e26f493bb5a45244b506054a', 'request_id': 'req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.569277 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] The token cache is being invalidate because project bd005aa4e26f493bb5a45244b506054a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:41:29.569564 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.570185 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.571703 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1465/2939] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:41:29 2022] DELETE /identity/v3/projects/bd005aa4e26f493bb5a45244b506054a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:29.576426 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:29.589223 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115cde0-67a8-45bb-99a6-bc9931785e61 service neutron] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:29.649583 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:29.650587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:29.650587 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:29.650847 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] PATH_INFO: `/v3/users/92f6099dccf0480bbcbac85c8484134d` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:29.652041 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f6099dccf0480bbcbac85c8484134d)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:29.653973 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:29.715949 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f6099dccf0480bbcbac85c8484134d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.725187 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f6099dccf0480bbcbac85c8484134d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.725817 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f6099dccf0480bbcbac85c8484134d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.733178 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f6099dccf0480bbcbac85c8484134d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.744815 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f6099dccf0480bbcbac85c8484134d'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:29.750534 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1475/2940] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:41:29 2022] DELETE /identity/v3/users/92f6099dccf0480bbcbac85c8484134d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:30.023027 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:30.024770 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:30.037672 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef202d-830c-42e4-a2ab-5c9c88de9dbe admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:30.097894 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:30.098666 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:30.099060 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:30.099450 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] PATH_INFO: `/v3/projects/f23c50f4caa84129907ec8b4cf47e39e` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:30.100946 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23c50f4caa84129907ec8b4cf47e39e)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:30.103604 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:30.149257 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:30.157641 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23c50f4caa84129907ec8b4cf47e39e', 'request_id': 'req-cd209f06-2d9f-496e-be23-1d13251ec21d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.163294 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23c50f4caa84129907ec8b4cf47e39e', 'request_id': 'req-cd209f06-2d9f-496e-be23-1d13251ec21d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.169891 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23c50f4caa84129907ec8b4cf47e39e', 'request_id': 'req-cd209f06-2d9f-496e-be23-1d13251ec21d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.185456 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] The token cache is being invalidate because project f23c50f4caa84129907ec8b4cf47e39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:41:30.185743 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.186418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.188261 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1466/2941] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:41:30 2022] DELETE /identity/v3/projects/f23c50f4caa84129907ec8b4cf47e39e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:30.192420 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:30.193919 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:30.203292 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:30.207147 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd232c-0210-49d9-ba40-f9395c05b577 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:30.267972 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:30.268609 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:30.268890 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:30.269163 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] PATH_INFO: `/v3/users/409bdde7dda04c38b5e04542b2f6b5d4` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:30.270389 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=409bdde7dda04c38b5e04542b2f6b5d4)` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:30.272382 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:30.324074 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '409bdde7dda04c38b5e04542b2f6b5d4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.332991 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '409bdde7dda04c38b5e04542b2f6b5d4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.333602 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '409bdde7dda04c38b5e04542b2f6b5d4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.340851 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '409bdde7dda04c38b5e04542b2f6b5d4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.353740 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.notifications [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '409bdde7dda04c38b5e04542b2f6b5d4'} {{(pid=81593) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.359927 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1476/2942] 10.222.0.18 () {58 vars in 1224 bytes} [Mon Sep 26 05:41:30 2022] DELETE /identity/v3/users/409bdde7dda04c38b5e04542b2f6b5d4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:30.641040 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Authenticating user token {{(pid=81592) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:41:30.642588 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.fernet_utils [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81592) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:41:30.655933 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd209f06-2d9f-496e-be23-1d13251ec21d admin admin] Validating token access rules against request {{(pid=81592) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:41:30.717093 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c1388531c2849fcb94bee4071a75c53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e12d4768420490681bee18f38969146', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81592) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:41:30.717731 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:41:30.718010 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:41:30.718284 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] PATH_INFO: `/v3/projects/8fccda73623242dbb26f171b392ed08f` {{(pid=81592) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:41:30.719418 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fccda73623242dbb26f171b392ed08f)` {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:41:30.721380 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] RBAC: Authorization granted {{(pid=81592) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:41:30.768091 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fccda73623242dbb26f171b392ed08f', 'request_id': 'req-4bde2089-e2fc-4bf5-b536-d6febe375d6d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.773452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fccda73623242dbb26f171b392ed08f', 'request_id': 'req-4bde2089-e2fc-4bf5-b536-d6febe375d6d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.779515 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fccda73623242dbb26f171b392ed08f', 'request_id': 'req-4bde2089-e2fc-4bf5-b536-d6febe375d6d'} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.794361 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] The token cache is being invalidate because project 8fccda73623242dbb26f171b392ed08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81592) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:41:30.794646 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.795279 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG keystone.notifications [None req-4bde2089-e2fc-4bf5-b536-d6febe375d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81592) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:41:30.796793 dv-cinder-859186-2-smb devstack@keystone.service[81592]: [pid: 81592|app: 0|req: 1467/2943] 10.222.0.18 () {58 vars in 1233 bytes} [Mon Sep 26 05:41:30 2022] DELETE /identity/v3/projects/8fccda73623242dbb26f171b392ed08f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:41:40.356632 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:41:40.791452 dv-cinder-859186-2-smb devstack@keystone.service[81592]: DEBUG dbcounter [-] [81592] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:43:28.105432 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Authenticating user token {{(pid=81593) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:43:28.107806 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:43:28.188016 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0daee-f993-4e7a-b1fb-a0600f2f24d4 admin admin] Validating token access rules against request {{(pid=81593) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:43:28.253002 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659cf783-b48c-45cb-b20d-700cc4f55bc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '236e8947ce084c019d269170624fa35b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db4696e870e4131aa66e3a7908c8928', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81593) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:43:28.253615 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cf783-b48c-45cb-b20d-700cc4f55bc9 service placement] REQUEST_METHOD: `GET` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:43:28.253893 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cf783-b48c-45cb-b20d-700cc4f55bc9 service placement] SCRIPT_NAME: `/identity` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:43:28.254167 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659cf783-b48c-45cb-b20d-700cc4f55bc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81593) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:43:28.256249 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.fernet_utils [None req-659cf783-b48c-45cb-b20d-700cc4f55bc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81593) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:43:28.267302 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cf783-b48c-45cb-b20d-700cc4f55bc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:43:28.268918 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659cf783-b48c-45cb-b20d-700cc4f55bc9 service placement] RBAC: Authorization granted {{(pid=81593) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:43:28.279976 dv-cinder-859186-2-smb devstack@keystone.service[81593]: [pid: 81593|app: 0|req: 1477/2944] 10.222.0.18 () {60 vars in 1365 bytes} [Mon Sep 26 05:43:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:43:38.275051 dv-cinder-859186-2-smb devstack@keystone.service[81593]: DEBUG dbcounter [-] [81593] Writing DB stats keystone:SELECT=58 {{(pid=81593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}